-- Logs begin at Thu 2022-05-26 15:42:59 UTC, end at Thu 2022-05-26 17:08:44 UTC. -- May 26 16:25:04.767328 dv-cinder-836071-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 16:25:04.776151 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 16:25:04 2022] *** May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: nodename: dv-cinder-836071-5-iscsi May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: machine: x86_64 May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: clock source: unix May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: pcre jit disabled May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: detected number of CPU cores: 4 May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: current working directory: / May 26 16:25:04.778682 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: detected binary path: /usr/bin/uwsgi-core May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: your processes number limit is 47680 May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: your memory page size is 4096 bytes May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: detected max file descriptor number: 2048 May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: lock engine: pthread robust mutexes May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: thunder lock: enabled May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 16:25:04.779261 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 16:25:04.823748 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: Python main interpreter initialized at 0x5596e83009c0 May 26 16:25:04.823748 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: python threads support enabled May 26 16:25:04.823748 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: your server socket listen backlog is limited to 100 connections May 26 16:25:04.823748 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: your mercy for graceful operations on workers is 90 seconds May 26 16:25:04.824131 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: mapped 403077 bytes (393 KB) for 2 cores May 26 16:25:04.824202 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: *** Operational MODE: preforking *** May 26 16:25:04.824489 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: *** uWSGI is running in multiple interpreter mode *** May 26 16:25:04.824489 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: spawned uWSGI master process (pid: 80244) May 26 16:25:04.824776 dv-cinder-836071-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 16:25:04.827178 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: spawned uWSGI worker 1 (pid: 80289, cores: 1) May 26 16:25:04.827178 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: spawned uWSGI worker 2 (pid: 80290, cores: 1) May 26 16:25:04.828037 dv-cinder-836071-5-iscsi devstack@keystone.service[80244]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 16:25:10.523951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:25:10.523951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 26 16:25:10.524868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:25:10.524868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: from cryptography.utils import int_from_bytes May 26 16:25:10.542802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:25:10.542802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 26 16:25:10.544007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 16:25:10.544007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 26 16:25:10.580514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:25:10.580760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:25:10.580963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] command line args: [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:25:10.581236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:25:10.581524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ================================================================================ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:25:10.581741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.581991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] config_dir = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.582180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.582495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] config_source = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.582677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] debug = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.582877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.583410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.583537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.583696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.583944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.584172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.584353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_config_append = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.584560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.584796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_dir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.584913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.585165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.585391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.585644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.585895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.586113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.586243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.586607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.586860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.587100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.587365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.587599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.587835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.588207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.588486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.588794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.589311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.102/identity {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.589575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] publish_errors = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.589875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.590703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.590904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.591061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.591312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.591552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] standard_threads = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.591913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.592162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.592358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.592538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] use_journal = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.592738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] use_json = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.593000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] use_stderr = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.593215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] use_syslog = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.593452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.593740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.593981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.594247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.594487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.594870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.595115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.595362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.595631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.596009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.596262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.596544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.596803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.597024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.597264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.597460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 16:25:10.597600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.597724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 16:25:10.597850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.597928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] command line args: [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 16:25:10.598057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.598268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 16:25:10.598391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.598494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ================================================================================ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 16:25:10.598695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.598790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.598908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.598986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_dir = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.599064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.599134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.599352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.599493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_source = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.599573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] debug = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.599743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.599863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.600021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.600136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.600227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.600293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.600487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.600577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.600752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.600959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.601092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.601200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.601278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.601398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_config_append = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.601479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.601556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.601749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_dir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.601838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.602054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.602149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.602310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.602440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.602540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.602614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.602798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.602905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.603132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.603365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603489 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.603606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.603915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.603989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.604083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.604166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.604319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.604449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.604584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.604662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.604821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.604904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.605072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.605160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.605323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.605446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.605574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.605735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.605869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.606049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.606179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.102/identity {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.606303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.606432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] publish_errors = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.606564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.606689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.606810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.606943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.606943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.607168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.607168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.607409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.607409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.607723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.607848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] standard_threads = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.607961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.608092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.608217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.608217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.608562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.608562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.608813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.609026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_journal = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.609146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.609267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_json = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.609267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_stderr = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.609520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.609646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_syslog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.609862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 16:25:10.610148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.610912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.611957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.612932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.613347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.613482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.613482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.613778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.613936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.614918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.615989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.616978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.617964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.618875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.619854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.external = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.620895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.621077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.621776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.621880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.password = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] auth.token = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.622974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.623944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.624867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.625882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.626999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.627903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.628958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.629935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.630908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.631855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.632918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.633963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.634867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.635926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.636867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.637538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.637646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.637780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.637898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.external = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.638885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.password = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.639892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.token = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.640939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.641907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.642740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.643919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.644877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.645882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.646912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.647898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.648995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.649980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.650937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.651958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.652854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.653855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.654894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.655931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.656887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.657975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] role.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.658879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] role.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.659995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.660930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.661901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.662917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.663846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.664959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.665966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.666917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.667921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.668839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.669992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.670945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.671928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.672977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.673277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.673367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.673541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.673668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.673906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.674939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.675966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.676791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.677924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.678139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.678228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.678379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.678565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.678644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:25:10.678823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.679333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.679615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.679997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.680254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.680520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.680811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.681194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.681451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.681705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.682141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.682386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.682643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.682907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.683161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.683432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.683672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.684487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.684755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.685002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.685241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.685480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.685716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.685974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.686233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.686486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.686729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.686971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.687205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.687444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.687690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.687942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.688172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.688491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.688876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.689120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.689370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.689645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.690034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.690279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.690572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.690841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.691183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.691448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.691715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.692094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.692411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.692688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.692946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.693220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.693596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.693849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.694094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.694332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.694606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.694971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.695222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.695494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.695735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.696121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.696402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.696637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.696891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.697246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.697493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.697758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 16:25:10.698061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 16:25:10.714564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.714792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.715563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.725808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.727995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.728236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.728499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.740728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.758404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.758722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.762338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.762572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.821008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.822642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.879184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.879386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.883116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.883443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.957011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.957239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.957483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.957730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.957993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.958238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.958742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.958980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.959212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.959449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.959795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.960017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.985278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.985502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.985728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.985968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.986916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.987111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.987341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.987638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.999250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:10.999570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.013978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.014303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.014529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.014801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80289) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.015776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.016009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.016227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.016485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.016706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 16:25:11.036155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.036403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:25:11.036498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.036708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:25:11.036794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.036928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:25:11.037031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.037204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.037296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 16:25:11.037495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.037634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.037779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.037891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.038110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.038242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.038424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.051879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.052168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.052476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.052797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.054249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.054582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.054851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.055141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.063091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.065526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.066443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.066747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.067050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.067400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.067708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.067975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.068428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.068847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.069152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.069264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.069476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.069684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.069783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.069976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.070380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.070693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.070927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.071462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.071759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.072161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.072545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.072824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.101779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.103908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.104343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.107673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.110007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.110422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.111249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.111553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.111875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.117232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.117522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.117850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.120849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.121209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.127105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.127560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.127664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.127884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.128013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.128155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.128485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.128801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.129125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.129439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.132491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.132902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.133190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.133476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.133760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.134043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.134310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.134582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.150580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.151524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.154223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.154517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.156188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.159353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.160216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.160583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.163194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.163529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.166721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.170570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.171469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.175331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.175848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.176149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.176504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.176860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.177220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.177563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.179794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.180090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.180411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.180707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.181001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.181287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.198835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.199147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.199459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.199725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.201146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.201435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.201703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.201967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.209480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.211210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.211497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.212213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.213985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.214282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.214788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.215189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.215525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.215847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.216137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.217414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.217697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.217984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.218260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.218536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.231150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.231514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.231809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.232094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.232396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.232687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.232804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.232994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.233110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.233323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.233616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.233900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.234186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.234476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.253104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.253314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.256703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.256840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.260064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.260176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.261733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.261841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.263398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.263603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.263698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.263917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.264041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.264217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.271470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.272361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.273118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.274038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.276399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.276680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.276972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.277261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.277651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.277950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.278274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.278585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.286609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.286906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.287313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.288046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.288405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.288811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.295937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.296224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.296534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.296824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.297099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.297379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.297655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.297950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80289) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 16:25:11.298228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.298885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.299991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.300263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.300569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.300847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.301112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.301409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.301709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80289) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 16:25:11.339886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5596e83009c0 pid: 80290 (default app) May 26 16:25:11.343909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c78f-35cd-43f0-b35f-703bf8c6de6f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:11.344207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c78f-35cd-43f0-b35f-703bf8c6de6f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:11.344572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610c78f-35cd-43f0-b35f-703bf8c6de6f None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:11.345643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5596e83009c0 pid: 80289 (default app) May 26 16:25:11.348866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1/1] 10.222.0.102 () {50 vars in 796 bytes} [Thu May 26 16:25:11 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:19.631104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:19.631667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:19.631667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:19.636019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1/2] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:19 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:19.641351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:19.641784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:19.641955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:19.709510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: INFO dbcounter [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] Registered counter for database keystone May 26 16:25:19.731349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG oslo_db.sqlalchemy.engines [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:25:19.738163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writer thread running {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:25:19.915695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80290) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:25:19.916033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80290) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:25:19.971784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:19.973441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:20.097899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 2/3] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:19 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:25:20.236578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:20.305842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: INFO dbcounter [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] Registered counter for database keystone May 26 16:25:20.325886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG oslo_db.sqlalchemy.engines [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 16:25:20.332338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writer thread running {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 16:25:20.453124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2758a5-87ba-49cd-8301-b89fb62ce167 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:20.457442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:20.458103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:20.458397 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:20.458686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:20.467627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:20.519050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:25:20.519395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15e3d-b521-4864-9b76-ce44218120f0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:20.529793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 2/4] 10.222.0.102 () {58 vars in 1329 bytes} [Thu May 26 16:25:20 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:25:20.535892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:20.550632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4e0f3-fd84-4c7b-9312-889bb4af2ef9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:20.555378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:20.556540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:20.556834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:20.557116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] PATH_INFO: `/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:20.559154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=6d72a14f73b1482981ce0e1b7a09f3ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:20.611776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 16:25:20.612124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eae46d-bb91-4609-b311-3488bb0383e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:20.616923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 3/5] 10.222.0.102 () {56 vars in 1212 bytes} [Thu May 26 16:25:20 2022] GET /identity/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea => generated 345 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:22.816843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7999-cf5f-4387-a02e-99c0d75bbb0d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:22.817358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7999-cf5f-4387-a02e-99c0d75bbb0d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:22.817475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7999-cf5f-4387-a02e-99c0d75bbb0d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:22.821497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 3/6] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:22.827519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:22.827923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:22.828095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:22.847303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:22.848860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:22.856772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 4/7] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:22 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 16:25:22.879395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7999-cf5f-4387-a02e-99c0d75bbb0d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:22.892068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7999-cf5f-4387-a02e-99c0d75bbb0d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:22.896297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:22.896967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:22.897256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:22.897540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:22.905370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:22.907159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab33a9b-6cb8-4257-b27e-ec52bc15a2a7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:22.915989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 4/8] 10.222.0.102 () {58 vars in 1329 bytes} [Thu May 26 16:25:22 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:25:22.921572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:22.930833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f0702-e94d-4f96-ae2b-57bb7de96724 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:22.935952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:22.936854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:22.937147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:22.937430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:22.938837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:22.940706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0c3e6-4a08-4cb5-b1d7-be99cb95a570 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:22.942293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 5/9] 10.222.0.102 () {56 vars in 1203 bytes} [Thu May 26 16:25:22 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:25.272626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a48c-6d82-439a-b4e7-5df385a673d8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.273149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a48c-6d82-439a-b4e7-5df385a673d8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.273253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89a48c-6d82-439a-b4e7-5df385a673d8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.273333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016712d-d557-4659-8caa-354a78f466eb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.273672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016712d-d557-4659-8caa-354a78f466eb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.273875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016712d-d557-4659-8caa-354a78f466eb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.274548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 5/10] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:25.275227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 6/11] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:25.280056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.280207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.280355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.280503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.280670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.280773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.297901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:25.299099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:25.322941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80289) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 16:25:25.323377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG passlib.handlers.bcrypt [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80289) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 16:25:25.370070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:25.372279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:25.383607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 7/12] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:25.405678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:25.431182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:25.476406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 6/13] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:25 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:25.501095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:25.518775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb53cd2-fd62-4261-b8eb-61fccafe2cb5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:25.556880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:25.557512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.557801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.558082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.718791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626b4e0-152c-495b-b05c-d26c139ccd87 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:25.721943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:25.747577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:25.749206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:25.757341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:25.758402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.758693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.758982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.771387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:25.773278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:25.782771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:25.783706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:25.784653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 7/14] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:25.790061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:25.856017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 8/15] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:25 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:25:25.861479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:25.891985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b406f1-e00d-4f9c-ac59-3591cd67646b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:25.927690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:25.928360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:25.928691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:25.929226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:25.929996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:25.930302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:25.931750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:25.944705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 8/16] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:25 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:25.950921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:25.963845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5ac83-91ae-46a3-8abe-246fdd679457 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:25.977923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:25.987964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:26.000439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:26.001240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:26.001528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:26.001809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:26.012392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:26.013908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:25:26.035003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:26.036140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:26.036980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:25:26.036980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:25:26.036980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:25:26.036980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:26.036980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 9/17] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:26.042308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:26.053566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a4249-5849-44e5-bb40-21d48521c5f4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:26.090272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:26.091148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:26.091437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:26.091713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:26.093304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:26.094876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:26.100823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 9/18] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:25 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:26.101945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:26.148054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a63b9-5e1a-4088-a521-2342e993c82c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:26.188283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:26.189303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:26.189704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:26.190130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:26.191268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:26.191738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:26.193976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:26.200224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:26.207553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483efa9-0e79-401b-8583-5294d7e606d4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:26.232398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 10/19] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:25:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:26.247914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:26.248786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:26.249080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:26.249367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:26.250718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:26.252310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570bf8e-58ef-4d37-8528-766972da1459 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:26.254086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 10/20] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:26 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:26.260262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:26.297501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:26.370263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39523f53-6458-4f1b-baed-2bb8c810d3cd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:26.406109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:26.406699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:26.406985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:26.407260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:26.408109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.domain.id=default, user.id=6f387b0c9da64b528c02340c2727e0f6) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:26.408448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:26.409916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67ac25-c1e3-42fa-b10c-28252ffd3459 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:26.417096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 11/21] 10.222.0.102 () {56 vars in 1327 bytes} [Thu May 26 16:25:26 2022] GET /identity/v3/role_assignments?user.id=6f387b0c9da64b528c02340c2727e0f6&scope.domain.id=default&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 234 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:28.972672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6998-2848-457b-a0b0-197eced78d8a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:28.973196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6998-2848-457b-a0b0-197eced78d8a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:28.973293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6998-2848-457b-a0b0-197eced78d8a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:28.974774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 11/22] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:28 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:28.980784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec53b-b6dd-42df-8e6f-4a704417147b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:28.981248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec53b-b6dd-42df-8e6f-4a704417147b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:28.981425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ec53b-b6dd-42df-8e6f-4a704417147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.005398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c52ec53b-b6dd-42df-8e6f-4a704417147b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:29.006614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c52ec53b-b6dd-42df-8e6f-4a704417147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:29.102009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 12/23] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:28 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:29.143869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6998-2848-457b-a0b0-197eced78d8a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:29.157473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39131-7e18-42c6-8bb7-d0e9a138dd57 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.157772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39131-7e18-42c6-8bb7-d0e9a138dd57 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.158062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39131-7e18-42c6-8bb7-d0e9a138dd57 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.160173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 13/24] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:29.177284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.177831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.178271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.205583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:29.207138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:29.264736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:29.306116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6998-2848-457b-a0b0-197eced78d8a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:29.343584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 14/25] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:29.372550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:29.373729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.374249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.374737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.382610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:29.406331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:29.408137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-82c46795-1e1b-4b18-b463-3bcf05d55048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:25:29.437154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:29.438101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:29.439137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:25:29.439137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:25:29.439137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:25:29.439137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:29.441355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 12/26] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:29.442892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e92db-91cf-40d6-a408-ec994abbf0c7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.443359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e92db-91cf-40d6-a408-ec994abbf0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.443791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e92db-91cf-40d6-a408-ec994abbf0c7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.445295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 13/27] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:29.450430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e92db-91cf-40d6-a408-ec994abbf0c7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:29.484913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:29.562590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25abf7-965d-4634-90b7-d76aaf2f6751 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:29.628904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:29.630232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.630685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.631405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.646757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:29.653481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e92db-91cf-40d6-a408-ec994abbf0c7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-33538557-4f0a-4d77-85ad-9e79bed7db26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:29.659280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:29.660307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:29.661340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:29.664704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 15/28] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:29.666715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.667426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.668422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.689485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:29.690770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:29.698401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:29.699801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.700404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.700693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.701420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:29.701736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:29.703580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e2f93-9518-40bf-9a01-299abdbbd6f4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:29.709219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:29.727060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 14/29] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:25:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:29.728684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bdbc-cf20-411b-833b-05ae5d6d79ed None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.729138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bdbc-cf20-411b-833b-05ae5d6d79ed None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.729563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9bdbc-cf20-411b-833b-05ae5d6d79ed None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.731702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 15/30] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:29.736655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9bdbc-cf20-411b-833b-05ae5d6d79ed None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:29.774586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 16/31] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:29.776582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:29.828429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:29.862241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9bdbc-cf20-411b-833b-05ae5d6d79ed None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:29.900024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57500f2b-f9ee-44c0-856b-9f5b9cf4fd13 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:29.915287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:29.916746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.917692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.918162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.919307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:29.920008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:29.922061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ff7f5-e98f-4aed-a5d8-fca9c6c9d90d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:29.937135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 16/32] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:29 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:29.939420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.940046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.940702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.945869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:29.946606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:29.946901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:29.947184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:29.947961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:29.950101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:29.971260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:29.974691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:29.985843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:30.105990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 17/33] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:30.107671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.197163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 17/34] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:25:29 2022] POST /identity/v3/projects => generated 302 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:30.199259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.230310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:30.295119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6215-90fe-4e1a-a79f-f1f07ca5c77a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:30.343732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524fb2a7-5595-414b-82c5-4ded70282e76 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:30.349190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:30.350759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.351540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.352238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.353938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:30.357240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:30.394701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:30.395792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.396146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.396543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.398222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:30.400125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:30.402828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 18/35] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:30 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:30.408564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.504186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:30.520600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 18/36] 10.222.0.102 () {60 vars in 1136 bytes} [Thu May 26 16:25:30 2022] POST /identity/v3/roles => generated 226 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:30.521923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.548072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b41c99-54b2-4912-a870-615274bc7096 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:30.592603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:30.592849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.593154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.593445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.594253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:30.595751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be414029-f0b2-40ba-976d-b824866a7c21 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:30.620097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 19/37] 10.222.0.102 () {60 vars in 1136 bytes} [Thu May 26 16:25:30 2022] POST /identity/v3/roles => generated 220 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:30.622581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3515c-2ede-4370-93ad-234fe6b26baa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.622881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3515c-2ede-4370-93ad-234fe6b26baa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.623165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3515c-2ede-4370-93ad-234fe6b26baa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.625008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 20/38] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:30.626326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70d80e-a1d0-4767-9023-290f44b7c8cb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.626618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70d80e-a1d0-4767-9023-290f44b7c8cb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.626905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a70d80e-a1d0-4767-9023-290f44b7c8cb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.629365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 21/39] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:30.637981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.638350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.638674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.659753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:30.661442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:30.670590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3603b-b2e9-487b-9a16-d1a8d99c1438 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:30.710777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:30.731842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:30.733410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.733943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.734451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.737257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:30.739704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d6f10-5ee2-49e7-9c11-82a54e8e8121 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:30.748339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 19/40] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:30.748339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.748339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.748339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.776667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:30.778877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:30.783807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 22/41] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:30.785090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.874999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:30.898602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 20/42] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:30.900417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:30.940557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b1164-9482-4fbe-a72e-3408fdd60c43 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:30.978058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:30.978942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:30.979227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:30.979514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] PATH_INFO: `/v3/domains/default/users/6f387b0c9da64b528c02340c2727e0f6/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:30.981709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6f387b0c9da64b528c02340c2727e0f6, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:30.983202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:30.998955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 23/43] 10.222.0.102 () {58 vars in 1366 bytes} [Thu May 26 16:25:30 2022] PUT /identity/v3/domains/default/users/6f387b0c9da64b528c02340c2727e0f6/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:25:31.000103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:31.028340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f68bc9-0043-4be7-b283-df05e09e23b6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:31.056962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:31.074887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:31.075721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:31.076081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:31.076394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:31.077743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:31.079252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:31.081221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 21/44] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:30 2022] GET /identity/v3/domains/default => generated 200 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:31.086806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:31.159468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d99ff1-9f5b-4b57-8702-74ae94f8b117 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:31.182451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:31.218002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f912c72e-b8c1-4012-bd8a-347428ca40a5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:31.223543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:31.224629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:31.225062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:31.225480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:31.226675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:31.228965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ea75a-ae29-49d6-b5b1-7fa72e550d1d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:31.248309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 24/45] 10.222.0.102 () {60 vars in 1136 bytes} [Thu May 26 16:25:30 2022] POST /identity/v3/roles => generated 224 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:31.267385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:31.268119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:31.268438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:31.268776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:31.269578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:31.271433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7530ed9-674d-4b54-a062-2e86518dec2b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:31.310213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 22/46] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:25:31 2022] POST /identity/v3/projects => generated 313 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:25:33.322921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600881-c6f9-4e3c-ad56-3a47f6e6b183 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.323422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600881-c6f9-4e3c-ad56-3a47f6e6b183 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.323511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2600881-c6f9-4e3c-ad56-3a47f6e6b183 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.324940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 25/47] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:33.330257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4580e-c119-4f19-9f1a-9edc8fa5870f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.330694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4580e-c119-4f19-9f1a-9edc8fa5870f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.331015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4580e-c119-4f19-9f1a-9edc8fa5870f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.349758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f7c4580e-c119-4f19-9f1a-9edc8fa5870f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:33.351098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f7c4580e-c119-4f19-9f1a-9edc8fa5870f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:33.399966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:33.430035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 23/48] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:33.453211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2600881-c6f9-4e3c-ad56-3a47f6e6b183 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.549126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd177c4-21c8-49c0-b92c-11f6737f854e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.549422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd177c4-21c8-49c0-b92c-11f6737f854e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.549714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd177c4-21c8-49c0-b92c-11f6737f854e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.551102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 24/49] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:33.556456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.556751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.557033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.558760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2600881-c6f9-4e3c-ad56-3a47f6e6b183 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:33.573390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:33.575050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:33.594637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:33.595438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.595734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.596019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.606465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:33.614257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:33.615155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:33.616128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 26/50] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:33.621295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.643724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 25/51] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:33.664329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:33.667157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.728592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e4855-c008-48e2-b765-94d594c07ab8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:33.765931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:33.766302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7351886-ea3a-4910-81e9-9334e8981fcf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:33.767182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.767644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.768203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.769277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:33.769827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:33.770220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:33.773116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:33.794218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 27/52] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:33.800102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.804360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:33.805183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.805472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.805754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.806941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:33.808959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:33.810584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 26/53] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:33.816164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.905992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:33.908905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fb152-bac4-436a-8caa-47d603cf96e0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:33.921251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75706446-6eb7-471e-b283-ba84eb41ac5d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:33.947613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:33.948536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.948886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.949172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.950422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:33.954822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:33.954822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 28/54] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:33 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:33.960005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:33.966480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85917-73ba-4242-847f-90175808600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:33.967155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85917-73ba-4242-847f-90175808600d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:33.967448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85917-73ba-4242-847f-90175808600d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:33.967733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f85917-73ba-4242-847f-90175808600d None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:33.968485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85917-73ba-4242-847f-90175808600d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:33.969953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f85917-73ba-4242-847f-90175808600d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:33.994674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 27/55] 10.222.0.102 () {60 vars in 1145 bytes} [Thu May 26 16:25:33 2022] POST /identity/v3/projects => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:25:34.069130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5db09-e0b3-41de-91d8-cf23d64f9937 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:34.110581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:34.111413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:34.111709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:34.111997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:34.113363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:34.114998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f0643-8e89-464b-8979-8879054aa0ed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:34.116777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 29/56] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:33 2022] GET /identity/v3/domains/default => generated 200 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:34.123385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85917-73ba-4242-847f-90175808600d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:34.151799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:34.238262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f85917-73ba-4242-847f-90175808600d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:34.274069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:34.274736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:34.275029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:34.275315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:34.276168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.domain.id=default, user.id=6f387b0c9da64b528c02340c2727e0f6) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:34.276521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:34.278011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21b3df-439b-46ec-ad8e-7ee37ab708ad None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:34.287566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 28/57] 10.222.0.102 () {56 vars in 1327 bytes} [Thu May 26 16:25:34 2022] GET /identity/v3/role_assignments?user.id=6f387b0c9da64b528c02340c2727e0f6&scope.domain.id=default&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 532 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:36.312185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cad7-c7a2-4ba7-ac00-b974db163179 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:36.312593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cad7-c7a2-4ba7-ac00-b974db163179 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:36.312787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4cad7-c7a2-4ba7-ac00-b974db163179 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:36.314156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 30/58] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:36.319538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:36.319948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:36.320128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:36.337582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:36.338805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:36.407609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 29/59] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:36.434352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cad7-c7a2-4ba7-ac00-b974db163179 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:36.471050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:36.535436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4cad7-c7a2-4ba7-ac00-b974db163179 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:36.568603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:36.569320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:36.569607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:36.569890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:36.571054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:36.572566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aec777-0c80-406a-abf9-812ce76cc157 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:36.574840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 31/60] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:36 2022] GET /identity/v3/domains/default => generated 200 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:36.580625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:36.599194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:36.679353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7ad6e-fa35-44f8-af17-c23de19731be None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:36.714729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:36.715414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:36.715700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:36.715979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:36.716740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:36.718223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445b50e-42a0-4fe8-8ae4-e6b787a14ac2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:36.743467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 30/61] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:25:36 2022] POST /identity/v3/users => generated 276 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:25:40.072213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916a3-4062-4e67-9b71-e3dc1ad0f5fb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.074283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916a3-4062-4e67-9b71-e3dc1ad0f5fb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.075028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28916a3-4062-4e67-9b71-e3dc1ad0f5fb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.078037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 32/62] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:40 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:40.087872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a363a-c206-46b8-988d-566165276dd8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.089860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a363a-c206-46b8-988d-566165276dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.090605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a363a-c206-46b8-988d-566165276dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.121707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3b1a363a-c206-46b8-988d-566165276dd8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:40.123568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b1a363a-c206-46b8-988d-566165276dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:40.218815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 31/63] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:40.248487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28916a3-4062-4e67-9b71-e3dc1ad0f5fb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:40.328904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6884e9-60d4-4a5b-9540-42b2f4707bf2 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.329508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6884e9-60d4-4a5b-9540-42b2f4707bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.330013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6884e9-60d4-4a5b-9540-42b2f4707bf2 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.331634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 32/64] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:40 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:40.337396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.337944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.338429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.348749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:40.363913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:40.366043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:40.401001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28916a3-4062-4e67-9b71-e3dc1ad0f5fb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:40.412755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:40.479555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:40.480924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.481229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.481796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.502803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 33/65] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:40.503714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:40.512122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:40.512991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:40.513754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 33/66] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:40.519477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:40.541649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:40.706779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a3266-2c1e-43b0-8729-f2d4c358fd39 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:40.709158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b20a87-981c-420d-a000-03abbd665295 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:40.743582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:40.744266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.744595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.744883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.746178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:40.746493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:40.747914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48be05-36dc-4217-9681-385e1eb16819 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:40.749478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:40.749833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:40.750900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.751426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.751887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.758894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 34/67] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:40.760437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1feb07-ab4a-4889-87df-a1572ea89885 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.760743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1feb07-ab4a-4889-87df-a1572ea89885 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.761814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1feb07-ab4a-4889-87df-a1572ea89885 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.762887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 35/68] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:40.765118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:40.768074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1feb07-ab4a-4889-87df-a1572ea89885 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dc39dbce-ffea-4570-a168-e0fb5ae827bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:40.773979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:40.774842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:40.775604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:40.778037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 34/69] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:40.779455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.779946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.780453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.798276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:40.800068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:40.832869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:40.892192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1feb07-ab4a-4889-87df-a1572ea89885 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:40.898199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 35/70] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:40.899358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:40.960014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:40.961981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:40.962829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:40.963346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:40.988039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:40.990422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:40.993241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 36/71] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:40.994614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.020726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc469a4-2946-4a2b-be22-06552efe504d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.065915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.067272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.068864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.069170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.069528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.070392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:41.070751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.072663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.081554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 36/72] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:41.086801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.107388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.123448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54717f-33c4-4016-a1f9-2d68109940b0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.159678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.160560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.160854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.161133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.173421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-170ff21b-11a3-403c-8777-17042c8245ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:41.182061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:41.183701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:41.184477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 37/73] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:25:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:41.185412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643293a3-3362-443d-bdbf-9447ae48987f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.185708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643293a3-3362-443d-bdbf-9447ae48987f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.185965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643293a3-3362-443d-bdbf-9447ae48987f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.189553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 38/74] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:41 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:41.193540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643293a3-3362-443d-bdbf-9447ae48987f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.209996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cc57-7601-47aa-96ba-d7b0ba361258 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.246273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.246987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.247312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.247856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.311748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643293a3-3362-443d-bdbf-9447ae48987f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.323757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.325296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8098cf-17d4-4d53-88b3-778e2e0bf416 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.325934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.344809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.347079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.347963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.348252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.348567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.349897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.351373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f52a1-cf16-4bc2-ab79-41fd7191d190 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.353062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 39/75] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:41.358605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b90c-a2ec-40d9-8c62-5253f8e0c8c5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.358605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b90c-a2ec-40d9-8c62-5253f8e0c8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.358605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8b90c-a2ec-40d9-8c62-5253f8e0c8c5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.358605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 40/76] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:41.358605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8b90c-a2ec-40d9-8c62-5253f8e0c8c5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.437388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 37/77] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:41.440312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ad87-89ae-4a8f-b910-b9085f986868 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.440653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ad87-89ae-4a8f-b910-b9085f986868 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.440950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310ad87-89ae-4a8f-b910-b9085f986868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.458470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8310ad87-89ae-4a8f-b910-b9085f986868 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:41.459674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8310ad87-89ae-4a8f-b910-b9085f986868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:41.463765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8b90c-a2ec-40d9-8c62-5253f8e0c8c5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.503430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.504245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.504577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.504864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.505642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:41.505946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.507388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.516238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 41/78] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:41.518383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.529067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 38/79] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:41.530340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.530717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.531008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.547246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:41.548451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:41.581274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.592249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.617970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 39/80] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:41.618831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.639171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a5e47-095e-479b-bed9-6a83aa2f3de7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.674948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.675614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.675902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.676183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.719149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbc824-fa49-4737-ad2b-c53056a1e57a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.743338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.744851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.752876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.753797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.754035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.754692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.755922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.757415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.759121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 40/81] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:41.764544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.789688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.808490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:41.845218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 42/82] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:41.846167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.864416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396312d9-5d26-497f-8bf6-bcf84f04bb49 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.898865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.899746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.900039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.900326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:41.902171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:41.903720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:41.905346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 41/83] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:41.907318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:41.952446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0b9e8-4948-42ac-8bb6-0ca2d2f0705b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:41.988162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:41.988992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:41.989292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:41.989574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.000497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:42.008619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:42.009431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:42.010171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 43/84] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:42.011304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.014090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad995fb2-9e83-4407-8c63-3dd2b818e37a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.014604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.029120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.052125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.052965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.053259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.053538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.054963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.056503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.058618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 42/85] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:41 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.058618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.124095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca702da-e57b-49af-9e67-5fc5e1ad9f51 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.159761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.160016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab5b95-158c-44e8-9ead-7be6ad81a03f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.160473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.160729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.161010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.161853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:42.162169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.163647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.169315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 44/86] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=43b33b457be34a02b9be138701888988 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.170257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.199510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669440-ff7e-4243-9171-069725de395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.200458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669440-ff7e-4243-9171-069725de395d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.200758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669440-ff7e-4243-9171-069725de395d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.201050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97669440-ff7e-4243-9171-069725de395d None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.203443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97669440-ff7e-4243-9171-069725de395d None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.205057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97669440-ff7e-4243-9171-069725de395d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.211764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 43/87] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.211764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669440-ff7e-4243-9171-069725de395d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.272246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.275865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.316093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c20c2f-f230-48a1-8cd2-94f817da4787 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.345993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97669440-ff7e-4243-9171-069725de395d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.358551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.359218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.359506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.359786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.388578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.389396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.389691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.390127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.391216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:42.391800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.393396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.403852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 44/88] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.404787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.438785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.440254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.512755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b361d6-9e94-4486-b8f6-adc65cacccd8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.515300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.527664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.551823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 45/89] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:42.553104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.555009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.555798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.556412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.556743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.558952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.560779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.590772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 45/90] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:25:42 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:42.591620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.704786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed729b79-7da6-4854-af79-474241ccb3c9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.738045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd7429-da2f-477d-9154-cfaab85a78c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.758367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.759952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.765860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.765860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.765860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=6f387b0c9da64b528c02340c2727e0f6) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:42.765860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.765860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.772210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 46/91] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/role_assignments?user.id=6f387b0c9da64b528c02340c2727e0f6&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.773285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.810728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.811549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.811843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.812127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.813766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.817653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.818632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.822195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 46/92] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.828503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.876474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:42.905392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8a094-c918-4096-bd48-4eb3a4aab807 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:42.948097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:42.949203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:42.949518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:42.949845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:42.951599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:42.953124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:42.955396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 47/93] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:42.961570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:42.974859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3484f2e-35ae-4927-b4da-8df2ed5c762e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:43.019236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:43.020297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:43.020893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:43.021431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:43.088132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:43.091599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c9e18-940b-494e-abbb-764a85f96627 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:43.115692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:43.118003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:43.145723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:43.147390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:43.147907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:43.148459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:43.149527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:43.150102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:43.151882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:43.158401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 48/94] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:43.158934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:43.253750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 47/95] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:43.259430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:43.389472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3237795-aa0d-4a52-b825-5e5991ded7fa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:43.429220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:43.430117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:43.430406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:43.430689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] PATH_INFO: `/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:43.431962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] RBAC: Authorizing `identity:get_project(project_id=d3913d5a8cf74691ae7a77a3bd09215e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:43.434068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e75bbc-8deb-494c-9b1f-8040ca2a629a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:43.435915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 49/96] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:43 2022] GET /identity/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e => generated 313 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:43.442128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:43.554103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d56cd-51ea-4a1c-83c8-6e75ccf560bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:43.595641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:43.596354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:43.596677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:43.596959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:43.597903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=d3913d5a8cf74691ae7a77a3bd09215e, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:43.598226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:43.599772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97715-b6ea-438e-9f26-d781a6cf7170 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:43.602012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:43.610534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 48/97] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:43 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=d3913d5a8cf74691ae7a77a3bd09215e&role.id=43b33b457be34a02b9be138701888988 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:44.933258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49dea-e5fb-4839-b5ec-44bba608bfd7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:44.933842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49dea-e5fb-4839-b5ec-44bba608bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:44.934139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d49dea-e5fb-4839-b5ec-44bba608bfd7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:44.935724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 50/98] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:44.948609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:44.949099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:44.949191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:44.969417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:44.979975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:45.082992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 49/99] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:45.105769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d49dea-e5fb-4839-b5ec-44bba608bfd7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:45.140483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:45.219752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d49dea-e5fb-4839-b5ec-44bba608bfd7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:45.256046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:45.256879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:45.257169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:45.257449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:45.268822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:45.276773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:45.277751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:45.278982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 51/100] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:45.284085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:45.403031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82ef29-2bf5-43f9-8783-5461e0856b53 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:45.432101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:45.440919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:45.441598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:45.441888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:45.442175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:45.442941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:45.443252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:45.444938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:45.454535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 50/101] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:45 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:45.460618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:45.564916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:45.574592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee0758-480f-4cc2-b543-f9fcf1ceef0a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:45.610833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:45.611887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:45.612179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:45.612494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:45.613725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:45.615189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:45.617176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 52/102] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:45 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:45.625486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:45.761552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4ca3f-a3b8-483a-8e1b-6669c25dd9a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:45.824771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:45.825567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:45.825854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:45.826133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:45.827435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:45.829032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa6729-1e29-4534-bf1b-56548e8df031 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:45.831214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 51/103] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:45 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:45.837540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:45.977041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1ecfa-1473-44b1-8d7c-f721990dd8f9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:46.047139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:46.048426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.048927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.049410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/615a6306259748a9a80aa390084a98e7/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.058068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, user_id=615a6306259748a9a80aa390084a98e7, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:46.059900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75b5fd-248a-4354-b1af-c0a7af6f5101 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:46.085912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 53/104] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:25:45 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/615a6306259748a9a80aa390084a98e7/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:25:46.172530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906604-ae53-472f-acaa-d22e9454a714 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.173670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906604-ae53-472f-acaa-d22e9454a714 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.174174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd906604-ae53-472f-acaa-d22e9454a714 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.176704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 52/105] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:46 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:46.184640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.184916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.185239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.210354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:46.210354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:46.237479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:46.317003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 54/106] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:46.355101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906604-ae53-472f-acaa-d22e9454a714 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:46.474167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:46.530577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd906604-ae53-472f-acaa-d22e9454a714 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:46.617801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:46.618994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.619522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.620597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.649749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4f505225-d7cf-4ff4-8baf-b4a1f9ad915a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:46.669688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:46.670907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:46.671919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:46.672808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 53/107] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:46.685677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:46.687316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1fa2-fb4d-4899-96f9-0cee49ceff4a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.688013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1fa2-fb4d-4899-96f9-0cee49ceff4a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.688567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a1fa2-fb4d-4899-96f9-0cee49ceff4a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.691431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 54/108] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:46.697476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7906-8f9e-45ea-8d67-466876d19793 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.697862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7906-8f9e-45ea-8d67-466876d19793 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.698215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f7906-8f9e-45ea-8d67-466876d19793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.734175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2b5f7906-8f9e-45ea-8d67-466876d19793 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:46.735907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b5f7906-8f9e-45ea-8d67-466876d19793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:46.823481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4ce6-c840-409a-993b-5800a15f320c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:46.869630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:46.870288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.870580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.870863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.871742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:46.872061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:46.873638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b9fe1-c893-41ec-a790-babfc11aee0d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:46.884454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 55/109] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:46.886447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f65-5e1b-49bd-acfc-0a9d2869596d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.886744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f65-5e1b-49bd-acfc-0a9d2869596d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.887030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f65-5e1b-49bd-acfc-0a9d2869596d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.889586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 56/110] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:46.890578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423f65-5e1b-49bd-acfc-0a9d2869596d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:46.909873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:46.918993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 55/111] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:46.920360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:46.920685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:46.920977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:46.970071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:46.971629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:47.098176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423f65-5e1b-49bd-acfc-0a9d2869596d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.119102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:47.157394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.158562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.159055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.159620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.161253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:47.162943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355479e-37a0-4f03-a323-417bfcf63b36 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:47.163407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 56/112] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:47.165271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.165592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 57/113] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:46 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:47.167070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1bcb-deda-465c-9c52-d2a5c8c4e2ee None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.167560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1bcb-deda-465c-9c52-d2a5c8c4e2ee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a1bcb-deda-465c-9c52-d2a5c8c4e2ee None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.169500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 58/114] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:47.174950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1bcb-deda-465c-9c52-d2a5c8c4e2ee None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.337202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:47.358541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92efc9b9-2870-47ef-b57f-279d3b73f22d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.374157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a1bcb-deda-465c-9c52-d2a5c8c4e2ee None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.407152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.408628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.409128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.409616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.424143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:47.431248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.432473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.433410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.433839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4a22e03f-db3a-4dfd-af94-7b40eadd2802 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:47.434381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:47.435481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:47.436453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:47.437455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 57/115] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:47.438470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:47.440150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:47.442218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 59/116] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:47.443224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.443839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.444149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.444475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.463365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:47.464667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:47.505721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:47.555612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 58/117] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:47.556618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.579130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84022a43-5606-438d-873c-b8d73cf40894 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.625700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.626978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.627469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.627945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.645408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:47.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:47.656836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:47.658462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 60/118] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:47.662061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.676487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:47.713378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b94c03-fd2e-455e-9771-5729b5406f4d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.769401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.770438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.770984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.771446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.772745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:47.773267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:47.775657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893657e5-382b-4da3-9d9d-9e4bea6a6c07 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:47.790889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 59/119] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:47.793851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f3d7-b42e-4b42-9572-853dfc115038 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.794344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f3d7-b42e-4b42-9572-853dfc115038 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.794839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201f3d7-b42e-4b42-9572-853dfc115038 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.797750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 60/120] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:47 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:47.799241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201f3d7-b42e-4b42-9572-853dfc115038 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:47.855319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70be911-053d-4ffb-b4da-60ea69e65dfe None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:47.855769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:47.916079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:47.918027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:47.918493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:47.918895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/6f387b0c9da64b528c02340c2727e0f6/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:47.922475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, user_id=6f387b0c9da64b528c02340c2727e0f6, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:47.924975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:47.947718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 61/121] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:25:47 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/6f387b0c9da64b528c02340c2727e0f6/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:25:47.949275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.001176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201f3d7-b42e-4b42-9572-853dfc115038 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:48.083089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:48.088060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.089412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.089985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.092359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:48.095566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:48.104978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 61/122] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/domains/default => generated 200 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:48.106721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.117787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:48.192013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7c2a1-46d8-4005-b526-8d65a61cebee None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:48.233913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:48.234419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.234711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.234998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.235842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:48.236163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:48.237690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b73e4b-e781-4100-ab4b-f07d24df338e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:48.247483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 62/123] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:48.253056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.253442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.253686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.272569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:48.273585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:48.305019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:48.319369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948f91a-2056-4354-969b-1d2c4620721a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:48.348766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 63/124] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:48.349613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.396400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:48.399223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.400583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.401939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] PATH_INFO: `/v3/users/d3e17f9890274a38931cc99260567f15` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.436620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e17f9890274a38931cc99260567f15)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:48.439547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:48.444114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 62/125] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:48 2022] GET /identity/v3/users/d3e17f9890274a38931cc99260567f15 => generated 290 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:48.445883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.496779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:48.593022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec3324-dc69-4e00-9c49-863ccc375ba5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:48.660826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:48.662387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.663382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.664426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.665834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:48.669253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:48.687153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede8fa6-2d38-4acc-a3c5-9c54726fe8d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:48.724172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 64/126] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:25:48 2022] POST /identity/v3/projects => generated 303 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:48.725846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.782422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:48.788434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:48.789745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:48.790749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:48.794549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:48.808241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:48.812418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 63/127] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:48 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:48.814535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:48.876853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.019155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180311-a2b3-4e9d-b685-aea43a973f57 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.049813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.081413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba0952-10b7-47fa-b221-3f039fa91ab8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.099994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.101939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.102246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.102533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.125265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:49.140967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:49.142988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 65/128] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:49.144729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.159777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.161282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.162046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.162827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.265711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ee76a-8f3a-4234-8ec7-b4dc66d192e2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.294885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.296318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.324798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.325892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.326265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.326623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.328220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.330257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb01fd3-3aa5-498f-9456-5bf825d15c94 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 66/129] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457235cc-c429-4a73-9ada-57e112191585 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457235cc-c429-4a73-9ada-57e112191585 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457235cc-c429-4a73-9ada-57e112191585 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 67/130] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:49.340282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457235cc-c429-4a73-9ada-57e112191585 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.351964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.390804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.459506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457235cc-c429-4a73-9ada-57e112191585 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.495788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 64/131] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:48 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:49.503486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.503486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.503486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.503486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.504042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:49.504042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.506152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.511652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36888e8d-7655-4713-b969-eb5bb93bfca9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.522726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 68/132] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:49.524327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.524646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.524931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.543782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:49.545761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:49.623057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 69/133] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:49.624001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.660255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.700940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a559eb1-843e-46ae-8e7b-6d34f952cb9f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.743167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5d3ba-f9b0-4f18-81fc-648675e5f935 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.750834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.771198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.773140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.773776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.774617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/615a6306259748a9a80aa390084a98e7/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.779693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, user_id=615a6306259748a9a80aa390084a98e7, role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.782903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.787096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.788354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.788863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.789310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.791164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.793090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.795311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 70/134] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:49.796542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.814766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 65/135] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:25:49 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/615a6306259748a9a80aa390084a98e7/roles/4adbf210244243b7a5724f918f6b9a5a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:25:49.816678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:49.914310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5b0a3-cc4c-459e-abde-28a4cee6e62e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:49.918989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:49.958517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:49.959724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:49.960204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:49.960681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:49.969474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:49.973124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:49.976164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 71/136] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:49.980158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:50.113480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6087dc8-55bf-4a88-9008-c3cc754b3fae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:50.201523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:50.202655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.203121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.203559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.224209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c231b-5dc3-4c0e-9b3d-23e49eb7c810 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:50.233969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:50.254586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:50.255525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:50.256279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:50.258761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 66/137] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:50.261704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:50.317615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:50.318887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.319496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.320081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.321940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=d3e17f9890274a38931cc99260567f15) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:50.322607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:50.326990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:50.333691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:50.350660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 72/138] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:49 2022] GET /identity/v3/role_assignments?user.id=d3e17f9890274a38931cc99260567f15&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=ea9281b0d0d94782b60813438d273730 => generated 260 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:50.350660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:50.444128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:50.520388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef2592-ae57-48ae-8956-9e31691dfa33 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:50.597831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:50.599438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.599950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.600494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] PATH_INFO: `/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.602890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] RBAC: Authorizing `identity:get_project(project_id=d3913d5a8cf74691ae7a77a3bd09215e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:50.606833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9f845-84a7-4b2c-8cd8-60854b6d4007 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:50.611596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 67/139] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:50 2022] GET /identity/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e => generated 313 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:50.615157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313da79-441f-4f03-8b98-9dae20682098 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.615425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313da79-441f-4f03-8b98-9dae20682098 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.615861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313da79-441f-4f03-8b98-9dae20682098 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.619393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 68/140] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:50 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:50.620864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313da79-441f-4f03-8b98-9dae20682098 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:50.686670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1fe05-75c8-4675-976f-4e6d8723ab56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:50.825154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:50.825854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.826141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.826426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.827193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:50.827500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:50.828965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c27606-47d0-431e-b59c-7615e73fcf38 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:50.840062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313da79-441f-4f03-8b98-9dae20682098 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:50.854823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 73/141] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:50 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:50.856049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.856346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.856661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.883873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:50.894695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:50.895938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:50.931213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:50.932665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:50.932975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:50.933257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] PATH_INFO: `/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e/users/615a6306259748a9a80aa390084a98e7/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:50.938326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3913d5a8cf74691ae7a77a3bd09215e, user_id=615a6306259748a9a80aa390084a98e7, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:50.939938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:50.973629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 69/142] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:25:50 2022] PUT /identity/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e/users/615a6306259748a9a80aa390084a98e7/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:25:50.975139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:51.118184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 74/143] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:51.198697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:51.283708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:51.316317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9a92d-848b-4dec-b27e-955816eecdc0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:51.441011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:51.442599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:51.443129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:51.443644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:51.448663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:51.451664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:51.470790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 70/144] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:50 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:51.481397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:51.509919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047ccdd-a3c9-4fbd-84a1-8ca18720bab5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:51.612544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:51.653235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:51.654245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:51.654646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:51.654936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:51.672633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:51.689990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:51.690904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:51.691702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:51.693507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 75/145] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 496 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:51.701302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:51.815997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec7a0a-ef25-4294-9e17-aebe95d2652b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:51.860797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:51.889470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94598-fd0f-46d3-9b4d-25c3c63a92a9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:51.943545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:51.944172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:51.944493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:51.944779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:51.945594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:51.945906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:51.947412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:51.958186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 76/146] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:51.963400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:51.964505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:51.965011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:51.965465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:51.965732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.191843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d357b7-41b7-404e-8e0b-253e5917e28a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:52.197640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:52.199691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:52.255595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:52.256556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:52.256848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:52.257132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] PATH_INFO: `/v3/users/6f387b0c9da64b528c02340c2727e0f6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.258595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] RBAC: Authorizing `identity:get_user(user_id=6f387b0c9da64b528c02340c2727e0f6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:52.260405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f341-1972-45c9-b12c-f88d28fedb67 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:52.266282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 77/147] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:51 2022] GET /identity/v3/users/6f387b0c9da64b528c02340c2727e0f6 => generated 248 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:52.266282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a486f3-f7cf-45f2-b014-ef6f3b4fb52d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:52.266282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a486f3-f7cf-45f2-b014-ef6f3b4fb52d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:52.266282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a486f3-f7cf-45f2-b014-ef6f3b4fb52d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.266282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 78/148] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:52 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:52.272042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:52.272459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:52.272694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.291965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:52.293245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:52.304628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:52.312209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:52.445257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 79/149] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:52.447215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:52.473867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 71/150] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 994 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:52.481666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:52.701555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68622f4-791e-4030-a32e-36c87a86a298 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:52.729736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d0d52-2027-4c68-846f-9d8bdf45250e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:52.823939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:52.825605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:52.826382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:52.827174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.866576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:52.869879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:52.870766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:52.871097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:52.871341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:52.874899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:52.876267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:52.878069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 72/151] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:52 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:52.878866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:52.904137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:52.988426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:52.989855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:53.116961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da346e6-416f-4efb-8e44-ee9db95408a7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.202083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:53.203194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.203619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.204084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.205553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:53.207058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:53.209056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 73/152] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:53.209654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:53.291263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 80/153] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 845 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:53.291910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:53.301681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:53.332796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7af90-f518-4c56-8db2-6b061be222df None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.372782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:53.373861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.374161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.374451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.375323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:53.375646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:53.377342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:53.384336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 74/154] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:53 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=43b33b457be34a02b9be138701888988 => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:53.385770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:53.412900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:53.519166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86dda8-9b2f-4a57-bae9-1dc81c30d746 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.563308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:53.564125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.564472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.564767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.566306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:53.567828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78886fa1-234e-4f0b-8ed2-0cfb11765b7d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:53.569904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 75/155] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:53 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:53.571225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1db2-e19c-45d2-b6f1-1d074a750abc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.571521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1db2-e19c-45d2-b6f1-1d074a750abc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.572033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1db2-e19c-45d2-b6f1-1d074a750abc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.574084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 76/156] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:53 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:53.580317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.580674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.580919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.590389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4937ec-a783-4074-a5d9-0531afd26b38 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.600805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:53.602034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:53.612983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:53.686683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:53.687755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.688043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.688346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:53.690509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:53.692055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:53.694590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 77/157] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:53 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:53.695499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:53.726143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 81/158] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:25:53 2022] POST /identity/v3/users => generated 284 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:53.743051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:53.911811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:53.918981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95072fe-3555-428d-8368-916cdef033c2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.976742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524cb97-8418-4099-a0c3-386fe3e3ae22 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:53.984800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:53.986633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:53.987421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:53.988216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.011048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:54.029197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:54.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:54.031858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:54.035453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 82/159] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:25:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:54.038949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.040336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.040890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.041441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.042651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:54.043325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=6f387b0c9da64b528c02340c2727e0f6) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:54.043942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:54.045937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:54.054649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 78/160] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:53 2022] GET /identity/v3/role_assignments?user.id=6f387b0c9da64b528c02340c2727e0f6&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:54.190937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6e74-34fd-4979-96bd-62287d2ae0b7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:54.247678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.248483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.248779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.249062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.249890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:54.250210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:54.251786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325b3e8-c523-4f5f-ac4e-d045e6e0e9f7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:54.262996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 83/161] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:54.268716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:54.271866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:54.317051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb21d7-9141-4200-bfc1-088b16f4da60 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.317347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb21d7-9141-4200-bfc1-088b16f4da60 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.317632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb21d7-9141-4200-bfc1-088b16f4da60 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.319326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 84/162] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:54.327481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.327481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.327481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.347651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:54.349095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:54.368986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:54.425000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90830c4-3594-44f2-adc5-ce72ea6501a3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:54.440128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 85/163] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:54.466854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:54.471513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.472468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.472753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.473032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.474364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:54.475847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:54.478588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 79/164] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:54.485666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:54.595525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:54.598566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa86e1-3b9f-4186-90d9-dfdf74644e2e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:54.638595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3c878-7cf1-45b8-8c88-276baf95e168 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:54.644422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.645234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.645522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.645802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.660685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a399bad2-609e-4ebd-a958-c9d929643feb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:54.669796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:54.670692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:54.671553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 86/165] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:54.672851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d81f7-9d55-49eb-9855-9be51906431f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.672851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d81f7-9d55-49eb-9855-9be51906431f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.673211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d81f7-9d55-49eb-9855-9be51906431f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.674743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 87/166] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:54.676870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d81f7-9d55-49eb-9855-9be51906431f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:54.686649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.688101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.688452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.688742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.695839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:54.788279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:54.790385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:54.823458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d81f7-9d55-49eb-9855-9be51906431f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:54.869108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:54.870103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.870395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.870682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.871922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:54.872251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:54.874156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b71054-9c76-4566-af09-151b0bcf2a25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:54.884278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:54.890532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 88/167] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:54.890532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:54.890532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:54.890532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:54.912278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:54.913617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:54.933746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 80/168] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:25:54.935596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.046852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 89/169] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:55.049251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.070551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:55.154538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a5723-a87c-4141-af4c-d754cd124b99 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.199492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c27d-7d66-4571-b5ae-ea9790f1ed3e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.242190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.243623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.244125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.245147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.246584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.248268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.250475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 90/170] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:55.251707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.256797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.257696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.257987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.258268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] PATH_INFO: `/v3/users/d3e17f9890274a38931cc99260567f15` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.262424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e17f9890274a38931cc99260567f15)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.263961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.266199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 81/171] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:54 2022] GET /identity/v3/users/d3e17f9890274a38931cc99260567f15 => generated 290 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:55.267006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.343751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:55.356603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:55.378247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2856-4396-4728-9e26-52a66e8ed0f6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.416562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.417922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.418427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.418920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.433956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:55.442701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:55.444036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:25:55.444854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:55.448547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 91/172] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:55.449681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.502128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6997fd6-9091-4313-9f2a-7b7cdc705220 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.568054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e434-eee6-4ba0-b9b9-755b77c2760b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.577552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.577894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.578186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.578478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.579527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:55.579861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.581754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.587997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 82/173] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 610 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:55.597145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.611468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.612864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.613398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.613942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.615764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.617844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.620264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 92/174] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:55.624071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:55.627211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:55.826514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcce1d4-f05a-4a33-b3bd-b08d331bdc9b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.834491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23cbfb-0e5a-4c89-a3dc-dc0ca888eef5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:55.836626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:55.875012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.876289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.876802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.877724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/d3e17f9890274a38931cc99260567f15/roles/ea9281b0d0d94782b60813438d273730` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.880016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, user_id=d3e17f9890274a38931cc99260567f15, role_id=ea9281b0d0d94782b60813438d273730)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.881925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.905458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 93/175] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:25:55 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/users/d3e17f9890274a38931cc99260567f15/roles/ea9281b0d0d94782b60813438d273730 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:25:55.941380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:55.942070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:55.942370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:55.942657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:55.943453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:55.943835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:55.945345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:55.960337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 83/176] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:55.966488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:56.084969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:56.152751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bac98-fa00-4a65-950e-29959f686d26 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:56.207504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:56.211986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:56.211986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:56.211986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] PATH_INFO: `/v3/users/615a6306259748a9a80aa390084a98e7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:56.211986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] RBAC: Authorizing `identity:get_user(user_id=615a6306259748a9a80aa390084a98e7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:56.211986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:56.218611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 94/177] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:55 2022] GET /identity/v3/users/615a6306259748a9a80aa390084a98e7 => generated 276 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:56.219997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:56.335113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d08112-82da-4502-b10f-4153e8d5e3b5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:56.389115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:56.389783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:56.390074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:56.390353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:56.430935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:56.505551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:56.507050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:56.674774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 84/178] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:25:56.680545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:56.823452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd5dd3-9ae5-480c-927a-9f158425ee67 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:56.863344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:56.872143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:56.873589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:56.874260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:56.874777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] PATH_INFO: `/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:56.876488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] RBAC: Authorizing `identity:get_project(project_id=d3913d5a8cf74691ae7a77a3bd09215e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:56.877979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f82df-9e8b-46db-8be5-c0c1aac52051 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:56.879741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 95/179] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:56 2022] GET /identity/v3/projects/d3913d5a8cf74691ae7a77a3bd09215e => generated 313 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:56.886221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:56.967784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:57.018528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d32d-a4c6-4d57-a0bc-eb74a8b49e37 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:57.078346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:57.079031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.079315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.079592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.080486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=d3913d5a8cf74691ae7a77a3bd09215e, user.id=615a6306259748a9a80aa390084a98e7) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:57.080807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:57.082331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858bd0a-36e1-445e-bfd0-c7d158e2b587 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:57.094030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 85/180] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:56 2022] GET /identity/v3/role_assignments?user.id=615a6306259748a9a80aa390084a98e7&scope.project.id=d3913d5a8cf74691ae7a77a3bd09215e&role.id=43b33b457be34a02b9be138701888988 => generated 610 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:57.411314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7987fc-93ba-4a3b-9540-279645e2d5c5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.411674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7987fc-93ba-4a3b-9540-279645e2d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.411878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7987fc-93ba-4a3b-9540-279645e2d5c5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.413533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 96/181] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:57.419878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.420462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.420538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.443308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:57.444971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:57.487811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4eef-7b03-4904-841f-a52fcb349294 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.488122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4eef-7b03-4904-841f-a52fcb349294 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.488416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf4eef-7b03-4904-841f-a52fcb349294 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.489957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 97/182] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:25:57.496802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac463f-4bb6-4ff1-a22c-687ac79f211f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.497111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac463f-4bb6-4ff1-a22c-687ac79f211f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.497367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac463f-4bb6-4ff1-a22c-687ac79f211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.517962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-52ac463f-4bb6-4ff1-a22c-687ac79f211f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:57.519751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-52ac463f-4bb6-4ff1-a22c-687ac79f211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:57.532162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 86/183] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:57.557467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:57.624838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 98/184] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:25:57.629315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d098f-0da4-4210-a08e-80a5455e3579 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.629315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d098f-0da4-4210-a08e-80a5455e3579 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.629315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d098f-0da4-4210-a08e-80a5455e3579 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.629315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 99/185] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:57.635551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.635829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.636091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.654743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:57.655423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:57.656274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:57.701807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f60d8b-e173-47d5-b0d1-ddc54c9286a7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:57.730612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 100/186] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:57.731603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:57.743156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:57.743954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.744239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.745069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.762324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:57.770348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:57.771532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:25:57.772546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 87/187] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:25:57.773362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:57.800944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:57.846613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf123b14-5431-4bcf-8481-6c62c9f2119e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:57.884749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:57.884960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fe521-719a-492b-9d42-6dfaae21c1db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:57.885502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.885790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.886054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.897330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:57.901885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:57.907166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:57.908149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:57.908965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 101/188] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:57.909687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:57.927523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:57.928323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:57.928895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:57.929179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:57.930373 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:57.931874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:57.938385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 88/189] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:25:57 2022] GET /identity/v3/domains/default => generated 200 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:57.938385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.023028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77588b-184e-4ef9-bfa9-4a8a7efc0470 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.039479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.042704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75771-db53-418a-a2b1-970c21a79130 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.060058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.060952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.061387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.061670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.062419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:58.062727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.064120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.072887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 102/190] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:58.077526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.079222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.079902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.080283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.080505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.081787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:58.081787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.082970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.091870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 89/191] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:25:57 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:58.097214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.148930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.186259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800d2b3-597b-4151-ac5a-5fda5cc4a7ae None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.218786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d78b4-fb46-435c-bf21-02a2c4bb1a99 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.227637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.228560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.228884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.229272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.230446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.232473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.264410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 103/192] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:25:58 2022] POST /identity/v3/users => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:25:58.264410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.267009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.267998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.268362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.268823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.286268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.287909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.290460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 90/193] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:58.295914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.316875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.404170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7f5b1-62ea-44ca-b7e9-f7464620c531 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.441244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9ee89-d9a4-44ed-81fe-f9bce5aa1347 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.452125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.459538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.460726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.461019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.461789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.463873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.466023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.467900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 104/194] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:58.473701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.487823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.488523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.488810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.489087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.584772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.586651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.600167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c505ef1-86fc-406c-ac00-a12432c4bcdd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.602779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.646008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.646840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.647128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.647403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.725252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 91/195] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:25:58.731942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.735202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.737651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30060a-7738-4a49-aa61-2eaf3181ee9e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.743214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.862688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 105/196] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:25:58.864413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e717-a4c1-4947-af25-bf02e7c12bba None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.864936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e717-a4c1-4947-af25-bf02e7c12bba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.865417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844e717-a4c1-4947-af25-bf02e7c12bba None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.867211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 106/197] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:25:58 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:25:58.868509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844e717-a4c1-4947-af25-bf02e7c12bba None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:58.870355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aca89-9a39-41bd-9923-2fcfd5322127 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:58.896751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:58.918134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:58.919005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.919291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.919569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.920820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:58.922352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a6861-6001-4af1-88c1-88ea8db5df2a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:58.924617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 92/198] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:25:58.930093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:58.930093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:58.930093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:58.952906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:25:58.955158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:25:58.991055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844e717-a4c1-4947-af25-bf02e7c12bba None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.028159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.029053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.029341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.029617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.030794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:59.032249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:59.039198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 107/199] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:25:58 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:59.040230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.050401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 93/200] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:25:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:25:59.051783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.056867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:59.127146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:59.166982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ea7e9-0a43-4d21-94c8-446d3ac54225 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.218302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.219995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.220562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.221040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.221822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c445db62-5d62-4538-8846-2a3142acf210 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.222380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=09faa497853f425f8e62f0d851b30843) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:59.222910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:59.225800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:59.233876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 108/201] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/role_assignments?user.id=09faa497853f425f8e62f0d851b30843&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:59.235406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.271989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.273141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.273429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.273737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.274613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=09faa497853f425f8e62f0d851b30843) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:59.274930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:59.276462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:59.284887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 94/202] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/role_assignments?user.id=09faa497853f425f8e62f0d851b30843&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:59.369992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68eaa8-1a8d-43bf-90e6-713a0e8a0f40 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.412834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.414064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.414549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.415024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.418049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:59.430764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:25:59.439350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:25:59.440323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:25:59.441149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:25:59.443861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 109/203] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:25:59.450114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.532113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:25:59.571793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fca244-a387-4f2a-898f-648f27ce9c3f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.614080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.615126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.615620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.616093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.617105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:25:59.617636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:59.619784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:59.629426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 95/204] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:59.635301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.745918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699fe80-213d-422c-8895-a429ba33db95 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:25:59.787694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:25:59.788958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:25:59.789461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:25:59.789931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] PATH_INFO: `/v3/users/d3e17f9890274a38931cc99260567f15` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:25:59.797238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] RBAC: Authorizing `identity:get_user(user_id=d3e17f9890274a38931cc99260567f15)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:25:59.799025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:25:59.801288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 110/205] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/users/d3e17f9890274a38931cc99260567f15 => generated 290 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:25:59.807374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:25:59.980123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cce7b-f2ff-48f2-8674-32a12063cc0a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:00.018126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:00.026623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:00.027673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:00.028163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:00.028667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:00.109856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:00.111749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:00.227790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 96/206] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:25:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:00.233780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:00.300471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:00.343249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb61fe-8157-4b81-9204-d0ea3450ff94 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:00.380777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:00.381567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:00.381853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:00.382127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:00.383350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:00.384901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2130f-df52-4bbf-b2eb-520f6b93a8f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:00.387426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 111/207] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:00 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:00.393403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:00.436743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:00.535223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b95879a-e75a-45dd-8389-52a4ad27e946 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:00.585323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:00.585985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:00.586271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:00.586546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:00.587392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, scope.project.id=6f621ffc69d648c492a664e7b87b08d8, user.id=d3e17f9890274a38931cc99260567f15) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:00.587707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:00.589371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a80e41-986d-44f2-b51c-2e961dfc2674 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:00.601480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 97/208] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:00 2022] GET /identity/v3/role_assignments?user.id=d3e17f9890274a38931cc99260567f15&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=ea9281b0d0d94782b60813438d273730 => generated 610 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:01.371489 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d2f6-bb4f-4af8-a58e-0532e17a4d4f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.372534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d2f6-bb4f-4af8-a58e-0532e17a4d4f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.373041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571d2f6-bb4f-4af8-a58e-0532e17a4d4f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.374688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 112/209] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:01.380836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.381486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.382000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.400809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:01.402402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:01.422660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958562-ea13-40a0-a4d4-984d5988b3b4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.423317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958562-ea13-40a0-a4d4-984d5988b3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.423816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47958562-ea13-40a0-a4d4-984d5988b3b4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.425433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 113/210] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:26:01.431278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.431968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.432506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.456016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:01.457581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:01.504402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 98/211] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:01.522541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:01.556078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:01.562584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 114/212] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:01.588664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:01.655830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:01.664408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7b43b-58ff-4070-9884-886217a167ff None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:01.703900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:01.704732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.705017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.705294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.705830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7e698-60a6-44e9-90bc-a8524d23d561 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:01.718385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:01.726400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:01.727359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:01.734185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 99/213] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:01.738091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:01.755188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:01.756460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.756758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.757038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.758546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:01.760335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:01.762931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 115/214] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:01.768623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:01.869347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:01.891941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cd9c1-c445-40f0-8ca4-95eff295c344 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:01.892981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfb96d-da72-4970-a7f6-beac013abe7c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:01.924079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:01.934900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:01.935580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.935868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.936143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.936902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:01.938476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93786f82-99bf-495a-b9a7-307e6488b70b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:01.939146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:01.940165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:01.940714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:01.941202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:01.942171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:01.942703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:01.944314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:01.963382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 100/215] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:01 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:01.965820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:01.980555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 116/216] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:01 2022] POST /identity/v3/users => generated 298 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:26:02.020653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4deed-5a98-4998-a723-a6d943bb882d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.020947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4deed-5a98-4998-a723-a6d943bb882d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.021227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4deed-5a98-4998-a723-a6d943bb882d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.022877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 117/217] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:26:02.028596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.028882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.029171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.048214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:02.049647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:02.117166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4862b8-0484-4691-bbbb-981805fab772 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.145567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 118/218] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:02.164035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.165344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.165830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.166815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] PATH_INFO: `/v3/users/d67e5b61c4634096a8422ba58c211e51` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.169799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.189954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] RBAC: Authorizing `identity:get_user(user_id=d67e5b61c4634096a8422ba58c211e51)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:02.192294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:02.200658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 101/219] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:01 2022] GET /identity/v3/users/d67e5b61c4634096a8422ba58c211e51 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:02.203448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.211228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.304897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8166fd5-7d80-4088-ba45-f453d612c710 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.332584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.350273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96136a-d549-419f-a074-cc17de9e015d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.364150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.365044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.365344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.366068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.386952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d603093e-3d5f-4fbb-9a02-6356e8cea8d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:02.395438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:02.396516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:02.397520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 119/220] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:02.398325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45329-dafe-4160-9179-ad50d4a836c8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.398325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45329-dafe-4160-9179-ad50d4a836c8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.398589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45329-dafe-4160-9179-ad50d4a836c8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.400509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 120/221] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:02.402557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45329-dafe-4160-9179-ad50d4a836c8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.406832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.407952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.407952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.408163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.501639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:02.503662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:02.508260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.534290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45329-dafe-4160-9179-ad50d4a836c8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.581125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.581812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.582098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.582378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.583387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:02.583700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:02.585634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a46ca2-af3c-458e-8fd3-0705a0200237 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:02.597369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 121/222] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:02.598909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.599204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.599486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.619148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:02.620944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:02.656949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.667309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 102/223] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:02.675146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.705802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 122/224] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:02.706681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.833115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8961-89a4-4838-852e-9bddafcade4f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.872340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.873234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.873518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.873794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.875025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:02.876710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:02.880500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 123/225] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:02.880500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:02.884548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00dcaa-0f3c-4c00-8e3c-7072830aa9b7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:02.889408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.940925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:02.969906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:02.971672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:02.972866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:02.973374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:02.976159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:02.977953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:02.980201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 103/226] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:02.984026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.007133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b7d8d-a77f-4925-a256-05969d742b8f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.055103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.057373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.057872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.058374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.085020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:03.096200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:03.097184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:03.097976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 124/227] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:03.099153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.155674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b3dd0-f60c-4e45-aa04-81693e4de32d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.227016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.228543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.229547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.230406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.233738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=d67e5b61c4634096a8422ba58c211e51) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:03.234336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:03.237580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:03.252249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 104/228] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:02 2022] GET /identity/v3/role_assignments?user.id=d67e5b61c4634096a8422ba58c211e51&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=43b33b457be34a02b9be138701888988 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:03.253148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.292059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:03.315358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f2dd3-0c26-42be-ac6a-b97e2eeee21a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.346224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:03.436470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.437374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.437662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.437941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.439300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:03.440829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:03.442872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 125/229] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:03 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:03.449622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.502135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45005a-6408-441d-81fd-e3d93be75f5e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.585557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.586730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.587242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.587811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.589343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:03.589918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:03.592926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:03.609933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 105/230] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:03 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:03.616816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.656331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd83bb-caf8-4557-afa5-fa87227ac02d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.732248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.734712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.735509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.736345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/09faa497853f425f8e62f0d851b30843/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.741859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, user_id=09faa497853f425f8e62f0d851b30843, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:03.747280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:03.780657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 126/231] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:26:03 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/09faa497853f425f8e62f0d851b30843/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:26:03.840279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:03.848889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340481ba-abd6-496e-bc36-dedf4ecbe801 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:03.894073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:03.894965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:03.895272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:03.895514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:03.901649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:03.903203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:03.905229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 106/232] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:03 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:03.912073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:03.976685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:04.139853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bb253-8d99-49cd-ad0f-71061b93e935 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:04.190827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:04.191716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:04.192001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:04.192256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:04.193726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:04.195204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b311-c281-472c-b909-00b1b4936c44 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:04.197964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 127/233] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:03 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:04.203626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:04.321021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e125c2-a44e-428b-872f-2da037a5494a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:04.361059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:04.361976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:04.362260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:04.362541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/09faa497853f425f8e62f0d851b30843/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:04.364981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, user_id=09faa497853f425f8e62f0d851b30843, role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:04.366469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1c1e7-cb32-422d-948e-6cce803e9453 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:04.395835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 107/234] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:26:04 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/09faa497853f425f8e62f0d851b30843/roles/4adbf210244243b7a5724f918f6b9a5a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:05.130387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59963-7a88-4c85-93c2-d4c9078c1738 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.131213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59963-7a88-4c85-93c2-d4c9078c1738 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.131213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac59963-7a88-4c85-93c2-d4c9078c1738 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.132621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 128/235] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:05.146404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.147170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.147170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.170516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:05.171721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:05.198044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:05.296681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 108/236] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:05.346170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59963-7a88-4c85-93c2-d4c9078c1738 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:05.477664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:05.502318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac59963-7a88-4c85-93c2-d4c9078c1738 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:05.553760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:05.554699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.554989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.555303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.557233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:05.558877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240f5f-58e8-4d37-b785-30f7d7e6908b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:05.560912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 129/237] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:05.569802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:05.707185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1888-6b05-4d50-8842-7c52b3ba5869 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:05.753252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:05.754558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.755051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.755550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.760579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:05.762349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:05.779669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f6b2-298c-44f0-9777-05948724e93c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.780477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f6b2-298c-44f0-9777-05948724e93c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.780981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400f6b2-298c-44f0-9777-05948724e93c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.782580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 130/238] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:05.790635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 109/239] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:05 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:05.795595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:05.796185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:05.796709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:05.827491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:05.829095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:05.945967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 131/240] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:05.987195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:06.017949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:06.146911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43d5ca-8af1-47fa-9375-65368e7bf76b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:06.186021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:06.186840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.187126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.187407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.199864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:06.208408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:06.209338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:06.210124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 110/241] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:06.215860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:06.360523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:06.379268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73e0e5-70ad-4a29-a100-4ef561261f38 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:06.432540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:06.433770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.434265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.434801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.435840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:06.436386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:06.438407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:06.455909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 132/242] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:06 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:06.460506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:06.564917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:06.604049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde19596-f4f6-43d8-9105-d0eac83f6bae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:06.673570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:06.674480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.674772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.675053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] PATH_INFO: `/v3/users/ef819a416fb34eddaf3afebed8d88e90` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.695295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] RBAC: Authorizing `identity:get_user(user_id=ef819a416fb34eddaf3afebed8d88e90)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:06.701048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9176767-e9ab-44a6-a611-91055856e7b3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:06.703407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 111/243] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:06 2022] GET /identity/v3/users/ef819a416fb34eddaf3afebed8d88e90 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:06.710317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:06.768779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db9-0686-453a-a01d-7962b30df653 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.769433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db9-0686-453a-a01d-7962b30df653 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.769929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894db9-0686-453a-a01d-7962b30df653 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.772087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 112/244] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:06 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:06.781918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234d733-bbe2-4a68-b79e-0a59ee4fff93 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.782505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234d733-bbe2-4a68-b79e-0a59ee4fff93 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.782798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234d733-bbe2-4a68-b79e-0a59ee4fff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.813414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7234d733-bbe2-4a68-b79e-0a59ee4fff93 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:06.815042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7234d733-bbe2-4a68-b79e-0a59ee4fff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:06.907966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5e4e27-1c4b-441b-acd5-f2360a9951e1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:06.942357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 113/245] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:06.943833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e597b7b-22c1-489f-9187-5bf36deb05c9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.944131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e597b7b-22c1-489f-9187-5bf36deb05c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.944440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e597b7b-22c1-489f-9187-5bf36deb05c9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.946089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 114/246] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:06.951750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.952047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.952333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:06.980509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:06.981931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:06.991574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:06.992540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:06.992977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:06.993405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.017468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.111868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:07.113764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:07.120828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.162232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 115/247] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:06 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:07.164012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:07.285685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 133/248] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:06 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:07.289587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:07.386389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.439851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7920c1c-9873-45e2-a67d-4ddb738fd388 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:07.448080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08dca9-3b6f-4710-aaa3-68a8c3dc847f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:07.500335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:07.501305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:07.501597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:07.501695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:07.501880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.502635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:07.502933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:07.503219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.516008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:07.524637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:07.526303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:07.527173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:07.529254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 116/249] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:07.530385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:07.537493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:07.546008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:07.547289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:07.548284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:07.550750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 134/250] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:07.551894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:07.614569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.714311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0a1cb-70bd-4e32-a92b-d5a390aaecb5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:07.803721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:07.804658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:07.804951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:07.805235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.809435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:07.810968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:07.814724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 117/251] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:07.816119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:07.876524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32143eb-bddf-4ace-8833-aeb1f4889a3a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:07.896860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.947843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b44843c-a49e-436a-8fac-ab28666a6bc5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:07.967760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:07.968436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:07.968779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:07.969068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.969350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:07.969855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:07.970163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:07.971787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:07.990886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:07.991939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:07.992510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:07.993004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:07.994578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:07.995114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:07.996833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:07.998859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 135/252] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:07.999777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.008016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 118/253] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:08.014247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.137859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cf110-2af5-47d8-b229-e9b29b932c50 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.179670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:08.182357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.182854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.183329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.184949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:08.186937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:08.189265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 119/254] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:08.190339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.252117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:08.252684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef4e7-5af3-4d55-b7d3-e8a4bef6eac7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.300813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:08.302942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.303894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.304461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.305496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=ef819a416fb34eddaf3afebed8d88e90) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:08.306709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:08.309241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb483535-5993-4b9a-823a-ca92750c9caf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:08.324022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 136/255] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:07 2022] GET /identity/v3/role_assignments?user.id=ef819a416fb34eddaf3afebed8d88e90&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=ea9281b0d0d94782b60813438d273730 => generated 260 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:08.324202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767a4682-2c41-4c52-9885-765256f93735 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.324353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790eba-c2c8-4a45-bb9b-9ea7f4ba06c8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.324353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790eba-c2c8-4a45-bb9b-9ea7f4ba06c8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.324353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82790eba-c2c8-4a45-bb9b-9ea7f4ba06c8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.324353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 137/256] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:08.324353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82790eba-c2c8-4a45-bb9b-9ea7f4ba06c8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.378931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:08.415031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:08.416648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.416938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.417217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] PATH_INFO: `/v3/users/d67e5b61c4634096a8422ba58c211e51` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.418658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] RBAC: Authorizing `identity:get_user(user_id=d67e5b61c4634096a8422ba58c211e51)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:08.420192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd14dc-eb7e-454f-aaa0-2869c696f592 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:08.428402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 120/257] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/users/d67e5b61c4634096a8422ba58c211e51 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:08.430264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.430707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.431130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.464781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:08.466360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:08.476402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82790eba-c2c8-4a45-bb9b-9ea7f4ba06c8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.512017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:08.512897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.513259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.513610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.599292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:08.601118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:08.644899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:08.684406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 121/258] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:08 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:08.685705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.731348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 138/259] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:08.737378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:08.852852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:08.886890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f683f-0ee4-4e8e-a5ce-db31802208f0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.966433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741bcd63-fa65-452c-9482-680edc1238b0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:08.968811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:08.969649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:08.969937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:08.970219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:08.973501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:08.983108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:08.992427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:08.993370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:08.994687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:08.997204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 139/260] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:08.998329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.011489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.012427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.012810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.013264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.014820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.016660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d3718a-07b5-4232-8f9a-8bb5e2e69129 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.018743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 122/261] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:09.020353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96daf37-c50e-446b-bf54-1e168f2daa71 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.020861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96daf37-c50e-446b-bf54-1e168f2daa71 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.021531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96daf37-c50e-446b-bf54-1e168f2daa71 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.023056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 123/262] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:09.024035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96daf37-c50e-446b-bf54-1e168f2daa71 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.125937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cec1de-e98f-4819-b164-f05945876f00 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.169003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.169828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96daf37-c50e-446b-bf54-1e168f2daa71 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.170175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.170469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.170750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.172035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.174920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.176765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 140/263] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:08 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:09.177555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.197571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:09.230659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.231798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.232325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.232858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.234219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:09.234792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.237367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd8c41-d01c-4762-86fa-c9158032b6ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.250093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 124/264] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:09.251257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.252318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.252717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.265345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:09.278632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:09.279860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:09.317586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb34f9-ac4d-4121-ba5e-d58f58b2fecf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.367402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.370298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.371165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.371960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/d67e5b61c4634096a8422ba58c211e51/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.376775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, user_id=d67e5b61c4634096a8422ba58c211e51, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.379393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.384453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 125/265] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:09.385663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.417696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 141/266] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:26:09 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/d67e5b61c4634096a8422ba58c211e51/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:09.419332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.530972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4bb8-8a0a-40d5-982d-d49099a50bdd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.548095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:09.597202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a18b7b-94ba-4db4-89b3-66c41d6b4a13 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.614639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.615717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.619552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.620172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.621297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=09faa497853f425f8e62f0d851b30843) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:09.623810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.626661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.642955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 126/267] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/role_assignments?user.id=09faa497853f425f8e62f0d851b30843&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:09.646782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.656056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:09.715950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.717742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.718393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.719092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] PATH_INFO: `/v3/users/09faa497853f425f8e62f0d851b30843` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.721291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] RBAC: Authorizing `identity:get_user(user_id=09faa497853f425f8e62f0d851b30843)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:09.724043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:09.735417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 142/268] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/users/09faa497853f425f8e62f0d851b30843 => generated 284 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:09.744675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.803012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d4169-2eb3-4901-9916-df9ec26939d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:09.858193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:09.865159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:09.865720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:09.866161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:09.891521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:09.913135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:09.914192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:09.915065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:09.916288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 127/269] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:09.925575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:09.964725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df9ce5-26cf-46e9-a701-e42833f3ba25 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.008969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.034764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.035688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.036130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.036615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.145950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.157286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.159101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dedb6bc-af16-4e5d-a0ed-dd9866c11e1c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.210501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa961-64d9-491c-bdff-e7617535e9d4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.277338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 143/270] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:26:10.280091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdfeb-643f-431b-ab7f-f952beda696c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.280680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdfeb-643f-431b-ab7f-f952beda696c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.281078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.281371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdfeb-643f-431b-ab7f-f952beda696c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.281972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.282338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.282714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.283604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:10.284967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.285389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 144/271] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:10 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:10.285891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2337c5-6c88-41db-85cd-756d173039dd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.286589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bdfeb-643f-431b-ab7f-f952beda696c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:10.303638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 128/272] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:09 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.305337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.305635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.305921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.326709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:10.328093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:10.396645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.408040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bdfeb-643f-431b-ab7f-f952beda696c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.412997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 129/273] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:10.413890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:10.447372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.448698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.449173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.450327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.450920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.452525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.455058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.457507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 145/274] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:10 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.465390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:10.538190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c8c59-ca08-4d64-b139-4c702dbc8fca None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.576343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.577114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.577402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.577675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] PATH_INFO: `/v3/users/a426afd09980482eae00f0611c341d4e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.583436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6a1ed-c244-4e32-a185-f92c1d30aad8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.593582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] RBAC: Authorizing `identity:get_user(user_id=a426afd09980482eae00f0611c341d4e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.595324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.597231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 130/275] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:10 2022] GET /identity/v3/users/a426afd09980482eae00f0611c341d4e => generated 294 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.598042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:10.624836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.626046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.626546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.627150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.628262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=09faa497853f425f8e62f0d851b30843) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:10.628822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.631189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.640220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 146/276] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:10 2022] GET /identity/v3/role_assignments?user.id=09faa497853f425f8e62f0d851b30843&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 610 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.641484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:10.676962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.737894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:10.783885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db4ad-f256-464a-aee0-ce5973828446 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.786384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46383e8-39dd-4b8d-a7bb-f8ab70927331 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:10.839583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.840791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.841366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.841843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.842902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, user.id=a426afd09980482eae00f0611c341d4e, scope.system=all) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:10.843429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.845394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.851586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 147/277] 10.222.0.102 () {56 vars in 1313 bytes} [Thu May 26 16:26:10 2022] GET /identity/v3/role_assignments?user.id=a426afd09980482eae00f0611c341d4e&scope.system=all&role.id=43b33b457be34a02b9be138701888988 => generated 227 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.876165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:10.877534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:10.878055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:10.878572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:10.880230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:10.882085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97120fb3-5dae-4e03-878c-c8ce14079d6a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:10.885140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 131/278] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:10.890601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:11.005813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:11.021687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ee35-5678-4d4f-9542-23bb94e4f271 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:11.061872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:11.063095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:11.063621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:11.064130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:11.065097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:11.066774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d0664-5eb6-4fb9-8b24-bd268f8b155b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:11.096819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 148/279] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:10 2022] POST /identity/v3/users => generated 294 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:11.960549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8bc4f-a34e-4508-ba6e-4e8d06703ab8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:11.962185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8bc4f-a34e-4508-ba6e-4e8d06703ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:11.963004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e8bc4f-a34e-4508-ba6e-4e8d06703ab8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:11.965881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 132/280] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:11 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:11.979266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dde-46e4-4256-8d38-e2f5ed7a2ffb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:11.980810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dde-46e4-4256-8d38-e2f5ed7a2ffb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:11.981608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013dde-46e4-4256-8d38-e2f5ed7a2ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:12.018425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a8013dde-46e4-4256-8d38-e2f5ed7a2ffb None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:12.020984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8013dde-46e4-4256-8d38-e2f5ed7a2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:12.181836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 149/281] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:11 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:12.228755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8bc4f-a34e-4508-ba6e-4e8d06703ab8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:12.493271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e8bc4f-a34e-4508-ba6e-4e8d06703ab8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:12.529286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4516-d1d4-444f-ae9e-c15bd58efbc3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:12.529610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4516-d1d4-444f-ae9e-c15bd58efbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:12.529859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a4516-d1d4-444f-ae9e-c15bd58efbc3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:12.531581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 150/282] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:12.538065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:12.538350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:12.538638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:12.590729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:12.592265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:12.592679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:12.593198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:12.593903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:12.596202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:12.618557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:12.635808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:12.636791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:12.638372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 133/283] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:12.643011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:12.658283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:12.770269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 151/284] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:12.798706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:12.804509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:12.898109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5332e3-b2d5-4180-9b32-ad41c4941313 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:12.982167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:12.983820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:12.984322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:12.984891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:12.985893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:12.986420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:12.988094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.003412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65709799-1ee4-450d-8093-c3d35c34451b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.008069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 134/285] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:12 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:13.014599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.084101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.085526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.086046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.086542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.127325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:13.158931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:13.159878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:13.160726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:13.161316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 152/286] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:13.174130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.204407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:13.265866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e0311-41d6-4c50-a90c-d7a6b04919d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.302803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:13.350988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.351788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.352073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.352346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] PATH_INFO: `/v3/users/ef819a416fb34eddaf3afebed8d88e90` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.355295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] RBAC: Authorizing `identity:get_user(user_id=ef819a416fb34eddaf3afebed8d88e90)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:13.356815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.358530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 135/287] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:13 2022] GET /identity/v3/users/ef819a416fb34eddaf3afebed8d88e90 => generated 298 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:13.364641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.387921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff9a32-4460-400a-8a66-d953506cc129 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.461229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.462421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.462919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.463430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.464938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:13.465512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:13.468155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.482239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 153/288] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:13.505524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.549506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfd6f46-d1dd-4ecd-8c80-a0d70bc6ab35 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.588274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.589195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.589489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.589770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.591126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:13.592658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.594748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 136/289] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:13 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:13.600156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.621212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:13.750619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534cf89-14ce-4edd-85c9-cc77ac5dc339 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.784586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:13.795774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.797013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.797385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.797742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] PATH_INFO: `/v3/users/d67e5b61c4634096a8422ba58c211e51` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.799628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] RBAC: Authorizing `identity:get_user(user_id=d67e5b61c4634096a8422ba58c211e51)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:13.801487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc01e09-efac-4656-81b4-fee480a10c77 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.803915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 154/290] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:13 2022] GET /identity/v3/users/d67e5b61c4634096a8422ba58c211e51 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:13.805621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327b2c-e4c2-45d5-afdc-4b28db1ac8a7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.806070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327b2c-e4c2-45d5-afdc-4b28db1ac8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.806422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327b2c-e4c2-45d5-afdc-4b28db1ac8a7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.808529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 155/291] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:13.817826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.818120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.818403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.832881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c8b98-56e8-43ae-8fdd-0fe8e675e26f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:13.841521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:13.843053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:13.879289 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:13.880723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:13.881272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:13.882087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/ef819a416fb34eddaf3afebed8d88e90/roles/ea9281b0d0d94782b60813438d273730` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:13.886138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, user_id=ef819a416fb34eddaf3afebed8d88e90, role_id=ea9281b0d0d94782b60813438d273730)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:13.888348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:13.905497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 137/292] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:26:13 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/users/ef819a416fb34eddaf3afebed8d88e90/roles/ea9281b0d0d94782b60813438d273730 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:13.906901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:13.976266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 156/293] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:14.074477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.090294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:14.185153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767990c-0d4c-4bb6-88c8-98d526b9bf50 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:14.232301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f6b14-4858-4e67-9c0a-f08bc83bfac2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:14.236774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:14.237476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.237763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.238053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.264333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:14.279101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:14.280580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.281204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.281701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.299298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1ff83815-5141-4dc2-93a8-6e2c9f9b3200 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:14.321948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:14.322974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:14.323813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:14.325046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 157/294] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:14.328418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad1fd-7e3e-444b-80d0-478c71d7e8b8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.328418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad1fd-7e3e-444b-80d0-478c71d7e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.328418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaad1fd-7e3e-444b-80d0-478c71d7e8b8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.336557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 158/295] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:14 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:14.338765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad1fd-7e3e-444b-80d0-478c71d7e8b8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.363734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:14.365907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf41dfd-f7d9-4dd3-b159-a6bcd69027ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:14.482480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:14.501300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaad1fd-7e3e-444b-80d0-478c71d7e8b8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:14.537358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 138/296] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:14.538926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.539229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.539505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.551153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:14.551834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.552838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.553389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.554189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:14.554680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:14.556173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549268c-fd10-42b9-b0ab-6f96f1eb08ad None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:14.559364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:14.560744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 159/297] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7b75-9c4b-4bff-ba60-a1781adf6ab4 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7b75-9c4b-4bff-ba60-a1781adf6ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7b75-9c4b-4bff-ba60-a1781adf6ab4 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 160/298] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:14.572422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe7b75-9c4b-4bff-ba60-a1781adf6ab4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.627371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:14.696897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 139/299] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:14.696897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.700076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe7b75-9c4b-4bff-ba60-a1781adf6ab4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:14.760588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:14.762555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.763007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.763441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.766060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:14.766523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51b21b-0dfa-4086-8a31-efaf20c43149 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:14.774052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 161/300] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:14.774052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.774052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.774052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.798675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:14.799876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:14.865513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:14.873648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c34005-c2fd-4086-b035-0e523f0a082c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:14.908932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 162/301] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:14 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:14.910818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.931615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:14.933312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:14.933905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:14.934489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] PATH_INFO: `/v3/users/a426afd09980482eae00f0611c341d4e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:14.937727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] RBAC: Authorizing `identity:get_user(user_id=a426afd09980482eae00f0611c341d4e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:14.940810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:14.944615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 140/302] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/users/a426afd09980482eae00f0611c341d4e => generated 294 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:14.946437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:14.994906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:15.057711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990ee7-3785-47ba-8d0b-1d9e7258c41f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.099309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.101224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.101715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.102177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.117767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:15.129044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:15.130065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:15.130872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:15.132647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a98443-f905-45a6-a3c5-f29ffd29e001 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.136269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 163/303] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:15.137131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:15.193416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.194524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.195030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.195529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.197236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=d67e5b61c4634096a8422ba58c211e51) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:15.197819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.200397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.211384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 141/304] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:14 2022] GET /identity/v3/role_assignments?user.id=d67e5b61c4634096a8422ba58c211e51&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=43b33b457be34a02b9be138701888988 => generated 610 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:15.212935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:15.270024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:15.293058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d1d32-6245-43e6-98a4-2b8ad081d1a5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.296940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:15.341932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.343224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.343922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.344529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] PATH_INFO: `/v3/system/users/a426afd09980482eae00f0611c341d4e/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.346676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a426afd09980482eae00f0611c341d4e, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.348508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.369332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 164/305] 10.222.0.102 () {58 vars in 1339 bytes} [Thu May 26 16:26:15 2022] PUT /identity/v3/system/users/a426afd09980482eae00f0611c341d4e/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:15.370987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:15.465308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d46b18-cc35-4cf1-aec2-5a368e81ddb7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.522980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.523801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.524085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.524394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.526302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.527977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.532419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 142/306] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:15 2022] GET /identity/v3/domains/default => generated 200 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:15.541599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:15.574871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1490-c72e-48ff-8f6c-96f607329f90 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.621861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.622559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.622840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.623124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.624080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:15.624413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.625994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.636255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 165/307] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:15 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:15.642994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:15.667201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:15.676652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349d044-ca73-4e4e-9f74-8db8941bfee0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.682675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:15.727242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.728625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.728923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.729209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] PATH_INFO: `/v3/groups` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.730380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.731966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.757799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 143/308] 10.222.0.102 () {60 vars in 1139 bytes} [Thu May 26 16:26:15 2022] POST /identity/v3/groups => generated 230 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:15.820804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab7c9c-4ce0-44a5-b52e-abc94d1b6963 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:15.878404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:15.879217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:15.879500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:15.879782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] PATH_INFO: `/v3/users/a87d2371b8ca4ae9aad4e983237310c8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:15.897591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] RBAC: Authorizing `identity:get_user(user_id=a87d2371b8ca4ae9aad4e983237310c8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:15.899174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2b7ce-8d90-48b4-9460-e3a9c3e06569 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:15.901511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 166/309] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:15 2022] GET /identity/v3/users/a87d2371b8ca4ae9aad4e983237310c8 => generated 294 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:15.907201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:16.044068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ddf25-9df3-4bfc-bb92-0cb1dd89334c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:16.108288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:16.109403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:16.109902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:16.110397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:16.111986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, user.id=a87d2371b8ca4ae9aad4e983237310c8, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:16.112571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:16.115312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3565a-f825-4f3a-ad8b-25b81a37f35f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:16.125653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 144/310] 10.222.0.102 () {56 vars in 1313 bytes} [Thu May 26 16:26:15 2022] GET /identity/v3/role_assignments?user.id=a87d2371b8ca4ae9aad4e983237310c8&scope.system=all&role.id=ea9281b0d0d94782b60813438d273730 => generated 227 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:16.658960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ed87-1c55-439c-a93f-74e531c97197 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:16.659466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ed87-1c55-439c-a93f-74e531c97197 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:16.659466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ed87-1c55-439c-a93f-74e531c97197 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:16.661318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 167/311] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:16.667444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:16.667961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:16.668057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:16.686487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:16.687933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:16.704930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:16.767335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 145/312] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:16.792103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ed87-1c55-439c-a93f-74e531c97197 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:16.897197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:16.914249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ed87-1c55-439c-a93f-74e531c97197 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:16.957042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:16.958290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:16.958782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:16.959252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:16.972115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:16.981457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:16.982377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:16.983180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:16.986252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 168/313] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:16.992757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:17.119526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e79704-5a50-4234-b63e-a9f5896e31c6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:17.160915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:17.161605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:17.161896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:17.162181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:17.162967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:17.163283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:17.164829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:17.175520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 146/314] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:16 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:17.182060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:17.301277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755589-7aa9-4bd1-ae07-b632bacd0066 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:17.350806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:17.351720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:17.352006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:17.352286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] PATH_INFO: `/v3/users/ef819a416fb34eddaf3afebed8d88e90` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:17.354182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] RBAC: Authorizing `identity:get_user(user_id=ef819a416fb34eddaf3afebed8d88e90)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:17.355669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:17.357689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 169/315] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:17 2022] GET /identity/v3/users/ef819a416fb34eddaf3afebed8d88e90 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:17.363250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:17.384741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:17.489978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf45a3d-d971-47f7-9ca9-c2d5787a874c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:17.530712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:17.531464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:17.531760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:17.532039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:17.610461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:17.611972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:17.627193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:17.725359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 147/316] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:17.734845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:17.764481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:17.857706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481da08f-6962-4ce3-81b7-e2360949e04f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:17.894432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:17.895335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:17.895623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:17.895899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:17.897209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:17.898685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624b99-bd6d-4227-9d3d-74762f341e17 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:17.900666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 170/317] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:17 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:17.906739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.019405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd590c80-c5d4-4b26-ada8-cbc68237311a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:18.034365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:18.057874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:18.058538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.058827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.059108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.059956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, scope.project.id=5c938ae8603546fd9fc6812352c34ffc, user.id=ef819a416fb34eddaf3afebed8d88e90) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:18.060275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:18.061790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec24b2-1c08-402e-8110-4488dcdf6005 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:18.069103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 148/318] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:17 2022] GET /identity/v3/role_assignments?user.id=ef819a416fb34eddaf3afebed8d88e90&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=ea9281b0d0d94782b60813438d273730 => generated 610 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:18.113982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751436-d603-4033-aa01-0d4b4a3f5015 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.114315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751436-d603-4033-aa01-0d4b4a3f5015 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.114552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb751436-d603-4033-aa01-0d4b4a3f5015 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.116355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 171/319] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:18.122484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.122778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.123067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.141723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:18.142978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:18.232811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 149/320] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:18.257232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751436-d603-4033-aa01-0d4b4a3f5015 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.367580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:18.393566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb751436-d603-4033-aa01-0d4b4a3f5015 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:18.436665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:18.437477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.437758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.438033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.451046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-53c55030-2ddb-48fd-85ec-b059ac299a50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:18.459268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:18.461861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:18.463375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 172/321] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:18.466819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.579019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6f3e-221d-482c-b78a-672bcad4d204 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.579434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6f3e-221d-482c-b78a-672bcad4d204 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.579915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e6f3e-221d-482c-b78a-672bcad4d204 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.582611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 173/322] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:18 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:18.588778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da2cc-00e0-49d6-8b26-d9dfeb1f0248 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.589068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da2cc-00e0-49d6-8b26-d9dfeb1f0248 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.589350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8da2cc-00e0-49d6-8b26-d9dfeb1f0248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.589851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1fe40-b402-477f-a524-41011846dfc8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:18.605147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:18.607284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ed8da2cc-00e0-49d6-8b26-d9dfeb1f0248 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:18.608633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ed8da2cc-00e0-49d6-8b26-d9dfeb1f0248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:18.642931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:18.643625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.643911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.644188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.645001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:18.645319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:18.646810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea759e-627c-42d9-9b3d-864d06e90cac None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:18.656888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 150/323] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:18.661843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000115-51c9-441e-9ee6-39cffd8a25e2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.662323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000115-51c9-441e-9ee6-39cffd8a25e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.662669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000115-51c9-441e-9ee6-39cffd8a25e2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.664337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 151/324] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:18.666020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000115-51c9-441e-9ee6-39cffd8a25e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.709861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 174/325] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:18.714170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.714637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.715080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.740051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:18.741979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:18.804986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000115-51c9-441e-9ee6-39cffd8a25e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:18.843923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 175/326] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:18.844198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:18.845234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:18.845522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.845669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:18.845821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] PATH_INFO: `/v3/users/a426afd09980482eae00f0611c341d4e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:18.847081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a426afd09980482eae00f0611c341d4e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:18.848638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:18.850714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 152/327] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:18 2022] GET /identity/v3/users/a426afd09980482eae00f0611c341d4e => generated 294 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:18.853505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:18.857210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:18.904866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:18.982765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4170-e2a2-488e-877c-eef4cb23c0c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.019629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.020309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.020621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.020908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.021746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] RBAC: Adding query filter params (role.id=43b33b457be34a02b9be138701888988, user.id=a426afd09980482eae00f0611c341d4e, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:19.022059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.023512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.027794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f054369-e4b0-4e22-828c-a35665803d29 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.037040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 153/328] 10.222.0.102 () {56 vars in 1313 bytes} [Thu May 26 16:26:18 2022] GET /identity/v3/role_assignments?user.id=a426afd09980482eae00f0611c341d4e&scope.system=all&role.id=43b33b457be34a02b9be138701888988 => generated 512 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:19.039188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:19.109441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.110685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.111133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.111532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.126764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:19.136420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:19.138281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:19.140021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 176/329] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:19.147200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:19.219067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:19.230915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a00ae-5476-4b40-9172-f55146870734 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.273600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:19.284091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.285086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.285486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.285925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.289261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.290910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.293367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 154/330] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:19.301738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:19.340145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281217a-b03b-4f40-a89d-b7e7b98cfd6d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.387229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.387987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.388360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.388759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.389655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:19.390059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.391633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.408510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 177/331] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:19 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:19.409839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:19.466232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883ce7e-c7f2-457b-8f56-a586b292e7a0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.513883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.514555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.514836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.515115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] PATH_INFO: `/v3/groups` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.515816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.517519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.533516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 155/332] 10.222.0.102 () {60 vars in 1139 bytes} [Thu May 26 16:26:19 2022] POST /identity/v3/groups => generated 227 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:26:19.553912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdb176-4d09-41f0-af06-e0098725c4db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.600671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:19.615117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.616533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.616965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.617385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] PATH_INFO: `/v3/users/a87d2371b8ca4ae9aad4e983237310c8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.619478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] RBAC: Authorizing `identity:get_user(user_id=a87d2371b8ca4ae9aad4e983237310c8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.621951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641be18-87bb-458f-8e69-b94db1b65eaa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.624753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 178/333] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:19 2022] GET /identity/v3/users/a87d2371b8ca4ae9aad4e983237310c8 => generated 294 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:19.631819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:19.663367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:19.764986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a16b18-f40c-4e41-963d-cdd057ecd740 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:19.805351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:19.806331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:19.806626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:19.806917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] PATH_INFO: `/v3/system/users/a87d2371b8ca4ae9aad4e983237310c8/roles/ea9281b0d0d94782b60813438d273730` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:19.808728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a87d2371b8ca4ae9aad4e983237310c8, role_id=ea9281b0d0d94782b60813438d273730)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:19.810219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944ede5-4dc5-4aa9-bf04-ac4c27314fe3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:19.822146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 156/334] 10.222.0.102 () {58 vars in 1339 bytes} [Thu May 26 16:26:19 2022] PUT /identity/v3/system/users/a87d2371b8ca4ae9aad4e983237310c8/roles/ea9281b0d0d94782b60813438d273730 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:22.913930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350507b3-294b-44b9-8b52-f730cf49ae9c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:22.916100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350507b3-294b-44b9-8b52-f730cf49ae9c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:22.916913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350507b3-294b-44b9-8b52-f730cf49ae9c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:22.920106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 179/335] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:22 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:22.927510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54a7ec-0ece-4670-b59d-1d920bd42e2d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:22.929292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54a7ec-0ece-4670-b59d-1d920bd42e2d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:22.930066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54a7ec-0ece-4670-b59d-1d920bd42e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:22.969560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5f54a7ec-0ece-4670-b59d-1d920bd42e2d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:22.972169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f54a7ec-0ece-4670-b59d-1d920bd42e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:23.148292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 157/336] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:23.188030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350507b3-294b-44b9-8b52-f730cf49ae9c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:23.277236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174dc3-f8cf-4a51-9c02-3f185aac2903 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:23.277824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174dc3-f8cf-4a51-9c02-3f185aac2903 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:23.278344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174dc3-f8cf-4a51-9c02-3f185aac2903 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:23.280287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 158/337] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:26:23.287367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:23.287991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:23.288530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:23.327378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:23.329081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:23.353150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:23.511131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350507b3-294b-44b9-8b52-f730cf49ae9c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:23.520489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 159/338] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:23.557996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:23.627202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:23.628909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:23.629622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:23.630297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:23.678284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:23.699396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:23.701365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:23.703152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:23.712994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 180/339] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 526 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:23.722178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:23.823892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4c58b-1f88-4529-8c36-d1ea6c0b322f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:23.879849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:23.895114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:23.896524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:23.897048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:23.897560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:23.942328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-062a141b-e596-4d8e-93ed-d6eeb8dfb7b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:23.961048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:23.963080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:23.964570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:23.973372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 160/340] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:23.976498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bfa9-e0f2-4887-897e-8af222c7b56b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:23.977381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bfa9-e0f2-4887-897e-8af222c7b56b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:23.978108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820bfa9-e0f2-4887-897e-8af222c7b56b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:23.985614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 161/341] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:23 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:23.987694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bfa9-e0f2-4887-897e-8af222c7b56b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:24.007394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:24.053286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6dd5c3-3db2-4962-a735-446454124378 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:24.178100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:24.179145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.179662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.180252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.181713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:24.182273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:24.184966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19010ce-4917-4413-99c8-42c6c1518bf5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:24.230648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 181/342] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:24.235509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36a58-07e1-40dd-b925-64d885b89099 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.236017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36a58-07e1-40dd-b925-64d885b89099 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.236556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec36a58-07e1-40dd-b925-64d885b89099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.260849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820bfa9-e0f2-4887-897e-8af222c7b56b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:24.279949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2ec36a58-07e1-40dd-b925-64d885b89099 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:24.281299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2ec36a58-07e1-40dd-b925-64d885b89099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:24.330246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:24.330946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.331235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.331520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.332308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:24.332828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:24.334433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:24.344580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 162/343] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:24.345698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:24.425066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 182/344] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:24.426676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04b00-1449-4e11-9119-23f21cd0fe9a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.427243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04b00-1449-4e11-9119-23f21cd0fe9a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.427976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04b00-1449-4e11-9119-23f21cd0fe9a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.429987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 183/345] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:24.431753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04b00-1449-4e11-9119-23f21cd0fe9a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:24.510220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:24.538498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:24.561329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18756e43-a249-465a-8c17-dabfc14f51b4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:24.605537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:24.606607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.607119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.607644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.659307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04b00-1449-4e11-9119-23f21cd0fe9a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:24.709275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:24.710719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5162c-99aa-47af-983c-958a66ed3be9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:24.759667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:24.761793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.762562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.763634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.813741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:24.864688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 163/346] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:24.866337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:24.866801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:24.867217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:24.889450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:24.891113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:24.953429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:24.955269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:25.015822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 164/347] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:25.024474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.051743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:25.184923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 184/348] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:24 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:25.187557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.297407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:25.305150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2db5c7-1002-431e-a56b-5a1544eb9eb6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.399724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:25.400838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.401306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:25.401744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:25.416503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:25.425062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:25.426153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 16:26:25.426976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:25.430476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 165/349] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:25.431780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.459700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a348a0-718c-4d52-8953-a4b666b2f1f8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.518718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:25.520063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.520584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:25.521048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:25.522714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:25.525441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:25.528252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 185/350] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:25.529685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.551674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:25.623414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516138e8-f063-4ea6-9c2d-0bbe4cd8bfd0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.687542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:25.688391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.688710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:25.688993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:25.702287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-da6d03f5-9ee6-41ca-be47-e18a2efa4cde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:25.710794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:25.711819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:25.712664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:25.714731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 166/351] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:25.720754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca709e2-98d0-46f7-ad90-721b745f0657 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.720754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca709e2-98d0-46f7-ad90-721b745f0657 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:25.720754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca709e2-98d0-46f7-ad90-721b745f0657 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:25.724019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 167/352] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:25 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:25.733291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca709e2-98d0-46f7-ad90-721b745f0657 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.742068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96013f1f-c6f7-43ac-9f34-e04d7e000f4e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.779698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:25.792397 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:25.793309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.793589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:25.794033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:25.795650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:25.798621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:25.800827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 186/353] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:25.802064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:25.943645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca709e2-98d0-46f7-ad90-721b745f0657 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.948142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:25.969386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8e626-e385-4f2e-b7b6-db5bb9814615 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:25.997068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:25.999019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:25.999637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.000610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.002228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:26.003466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.005993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.021267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 168/354] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.022942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.032832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.034344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.034828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.035330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.045878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.048700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09016de9-899f-4a68-bba4-35da47650651 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.052046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 187/355] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:25 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.054422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.054881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.055925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.093492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:26.094744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:26.150422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:26.183033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dd201-6f3e-4a5e-9c5f-c9729a3e539e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.203654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 188/356] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:26.206014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.237971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.237971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.237971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.237971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.238372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:26.238633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.240056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.253440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 169/357] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.254125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.326077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:26.359538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9442f6-c380-460b-9711-e4b5fbab99f7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.400937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f816470-5a86-4b98-bf6a-396def9ff0d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.415297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.416614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.417086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.417563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.419470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.421630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.423338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 189/358] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.424221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.454336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.455554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.455972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.456363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] PATH_INFO: `/v3/users/a87d2371b8ca4ae9aad4e983237310c8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.457920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] RBAC: Authorizing `identity:get_user(user_id=a87d2371b8ca4ae9aad4e983237310c8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.459413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1021d-a382-4073-9ed0-ebbea07b19ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.465439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 170/359] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/users/a87d2371b8ca4ae9aad4e983237310c8 => generated 294 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.465439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e30d-c546-441c-972a-c26625fc6e50 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.465439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e30d-c546-441c-972a-c26625fc6e50 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.465439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037e30d-c546-441c-972a-c26625fc6e50 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.465439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 171/360] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:26.465886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e30d-c546-441c-972a-c26625fc6e50 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.487229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:26.582066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6425b-a9a0-4d57-99b5-ee36f10e02c3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.626631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.627489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037e30d-c546-441c-972a-c26625fc6e50 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.627596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.627981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.628491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.629475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=6f621ffc69d648c492a664e7b87b08d8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:26.629877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.631352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.638264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 190/361] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 261 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:26.638928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.666312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:26.692943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.693938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.694291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.694649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.711412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:26.724408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:26.726282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:26.727914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 172/362] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:26.729277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:26.850214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514da60-9ca7-470d-93f9-25214643077f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.871700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:26.895056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.895730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.896015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.896299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.941516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f3b7e-2289-482b-aa19-fb0f7b3bff6e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:26.988086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:26.988805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:26.989094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:26.989382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:26.990531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=43b33b457be34a02b9be138701888988, scope.project.id=6f621ffc69d648c492a664e7b87b08d8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:26.990851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:26.992456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:26.999884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 173/363] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=43b33b457be34a02b9be138701888988 => generated 261 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:27.001186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:27.002740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d33db-cd26-4cfd-9222-411e35d91bcb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:27.005382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.017531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:27.183577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db1c75-d79e-4546-a694-5bdb0ee883ce None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:27.192663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 191/364] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:27.195179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.195506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.198087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.236360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:27.237827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:27.238509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.238619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:27.238799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.239085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.239950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] RBAC: Adding query filter params (role.id=ea9281b0d0d94782b60813438d273730, user.id=a87d2371b8ca4ae9aad4e983237310c8, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:27.240268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:27.241803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:27.244198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:27.261260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 174/365] 10.222.0.102 () {56 vars in 1313 bytes} [Thu May 26 16:26:26 2022] GET /identity/v3/role_assignments?user.id=a87d2371b8ca4ae9aad4e983237310c8&scope.system=all&role.id=ea9281b0d0d94782b60813438d273730 => generated 512 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:27.262675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.408286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 192/366] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:27.411570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.536502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:27.551013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6db53c-4a09-490a-a144-e7e2d78e61d4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:27.609848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967cfbf-88bf-405a-b1d4-be8de27ba271 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:27.630006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:27.631495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.631992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.632495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.634513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:27.635029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:27.637951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:27.652267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:27.653183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.653469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.653750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.655058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:27.656049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 175/367] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:27.656590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:27.657477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.658650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 193/368] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:27.665450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.776205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:27.787940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57f0e5-abac-4fbf-a656-b6fa39f320f0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:27.796856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:27.851507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:27.853582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.854478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.854992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.857485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:27.860290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:27.864604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 194/369] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:27.866338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:27.881924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d50d-aa2d-4136-9e34-f93e60427cad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:27.932916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:27.934941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:27.935380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:27.935780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:27.961004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:27.980258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:27.983761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 176/370] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:27.986966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:28.057883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a87bc-b405-4dac-934e-588749b9f49b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:28.115290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:28.115984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:28.116270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:28.116584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:28.138374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a2e2a-87dc-4226-ba8d-eb789ebcac4d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:28.157332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:28.186174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:28.194233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:28.196214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:28.196781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:28.197062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:28.197959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=43b33b457be34a02b9be138701888988, scope.project.id=5c938ae8603546fd9fc6812352c34ffc) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:28.198274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:28.199776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:28.212916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 177/371] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=43b33b457be34a02b9be138701888988 => generated 261 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:28.214083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:28.234479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:28.236789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:28.489360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7b926-ecb3-4236-8d6c-967a2345068f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:28.531625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 195/372] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:27 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:28.539319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:28.585934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:28.587474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:28.587956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:28.588347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:28.589260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:28.589690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:28.591232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:28.613465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 178/373] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:28 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:28.625986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:28.754333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:28.765213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:28.846687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e165683-4418-4248-abe7-d842b3edacd1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:28.909845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:28.911246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:28.911680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:28.912103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:28.914800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:28.917286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:28.920894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 196/374] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:28 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:28.922627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278c3cd-37c9-42a7-8d19-a43f7d6a989e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:28.932399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:28.961527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:28.962209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:28.962498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:28.962782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:29.136767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:29.138162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:29.171795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25719fdf-41bd-420b-a3cb-4150062e5340 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:29.215457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:29.242289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:29.244297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:29.244912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:29.245429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:29.247770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:29.250853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:29.254997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 197/375] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:28 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:29.267225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:29.295189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:29.342157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 179/376] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:29.350438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:29.495984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf00a61-f6e3-4be2-8013-2832e70b2c57 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:29.563402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:29.564567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:29.565082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:29.565585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:29.567349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=5c938ae8603546fd9fc6812352c34ffc) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:29.567908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:29.571336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:29.585520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 198/377] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:29 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 261 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:29.648252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6047714e-9d78-413f-b5ec-81bba0c23d0a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:29.724331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:29.725979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:29.726478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:29.727017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] PATH_INFO: `/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:29.729429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] RBAC: Authorizing `identity:get_project(project_id=6d72a14f73b1482981ce0e1b7a09f3ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:29.732740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:29.735965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 180/378] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:29 2022] GET /identity/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea => generated 345 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:29.746504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:29.900990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:29.913310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6699cc-fa41-4ff6-af77-c0e7b7b11501 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:29.953603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:29.954480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:29.954765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:29.955045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] PATH_INFO: `/v3/groups/5dfab4c2f550462fa05bee63f665756f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:29.961030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] RBAC: Authorizing `identity:get_group(group_id=5dfab4c2f550462fa05bee63f665756f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:29.963072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1388b-acf7-4423-8254-db581cfed976 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:29.965288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 199/379] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:29 2022] GET /identity/v3/groups/5dfab4c2f550462fa05bee63f665756f => generated 230 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:29.973578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:29.990006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:30.130593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c2ccf-a7f2-428b-bbca-150ff6d354ed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:30.185802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:30.186923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.187415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.187915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.189003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] RBAC: Adding query filter params (group.id=5dfab4c2f550462fa05bee63f665756f, role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6d72a14f73b1482981ce0e1b7a09f3ea) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:30.189546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:30.191247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43fa5d-9b42-4445-963c-ae4a62921def None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:30.201120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 181/380] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:29 2022] GET /identity/v3/role_assignments?group.id=5dfab4c2f550462fa05bee63f665756f&scope.project.id=6d72a14f73b1482981ce0e1b7a09f3ea&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 261 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:30.216400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f7562-33b4-4d0b-b991-590b3483e16f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.216400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f7562-33b4-4d0b-b991-590b3483e16f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.216400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f7562-33b4-4d0b-b991-590b3483e16f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.216400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 200/381] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:30.221385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.222375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.222862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.243131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:30.244887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:30.251498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac4b7-ba7f-42c9-a297-10366355692c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.252057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac4b7-ba7f-42c9-a297-10366355692c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.252057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ac4b7-ba7f-42c9-a297-10366355692c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.253920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 201/382] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:30.267640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.267944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.268205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.287454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:30.288768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:30.392783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 182/383] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:30.412258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:30.415049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:30.433776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 202/384] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:30 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:30.457596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:30.556849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:30.596664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e98d71a-7ffe-48e1-bfb2-eb17748b2fd2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:30.625970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440903e3-f71f-42f0-b987-a060b68fb47a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:30.637077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:30.638326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.638816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.639291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.652316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:30.661146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:30.662081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:30.662867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:30.665814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 183/385] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:30.673533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:30.733200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:30.734024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.734475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.734906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.751977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:30.764159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:30.774546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:30.775733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:30.776778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:30.779834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 203/386] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:30.787282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:30.869494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45278c5-fce6-4032-9c2c-3d3c9d9b04c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:30.975189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:30.976207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:30.977213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:30.977672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:30.979017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:30.979528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:30.981989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:30.997330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 184/387] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:30 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.003780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:31.086406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfd2ee-2290-47fd-8232-fa9adf41d96e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:31.139958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:31.156137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:31.157457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:31.158117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:31.158635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:31.159710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:31.160183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:31.162958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:31.181083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 204/388] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:30 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.189183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:31.346503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07f8f9-d3cf-462d-840e-ed3e25b2a866 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:31.406286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:31.430553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:31.432347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:31.432910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:31.433411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:31.435881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:31.440479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:31.445105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 185/389] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:31 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.451572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:31.530437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a16b9-8142-406f-bd0e-e8f5d1d1e8c6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:31.629816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:31.630636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:31.630924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:31.631213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:31.634625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:31.636151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:31.640110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 205/390] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:31 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.649581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:31.655663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6d15c-e3bc-49d9-9a36-f41b14e5d977 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:31.715890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:31.722188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:31.722695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:31.723195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:31.729854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:31.732961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:31.740955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 186/391] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:31 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.744546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:31.756157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:31.847858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf62deb-7bb6-4cd9-981d-b72c8abf528f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:31.921337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:31.964775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:31.966244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:31.966720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:31.967192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:31.969334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:31.972136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:31.975691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 206/392] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:31 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:31.982735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:32.052666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d06dc-c31f-4f70-b388-b619c8a8b378 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:32.118586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:32.119829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.120316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.121000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/groups/31acad1dc881426d9df99f2d9d15d444/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.125264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, group_id=31acad1dc881426d9df99f2d9d15d444, role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:32.128420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ac57-b366-466a-b425-a05040079dbd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:32.157654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 187/393] 10.222.0.102 () {58 vars in 1447 bytes} [Thu May 26 16:26:31 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/groups/31acad1dc881426d9df99f2d9d15d444/roles/4adbf210244243b7a5724f918f6b9a5a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:26:32.159790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3191-d0a8-4fcc-893a-a6dff59075dd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.160263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3191-d0a8-4fcc-893a-a6dff59075dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.160713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b3191-d0a8-4fcc-893a-a6dff59075dd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.162756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 188/394] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:32.172635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d69de-0d1e-4c0e-b83c-c9346f7df10e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.173140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d69de-0d1e-4c0e-b83c-c9346f7df10e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.173557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d69de-0d1e-4c0e-b83c-c9346f7df10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.236734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7f5d69de-0d1e-4c0e-b83c-c9346f7df10e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:32.238882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f5d69de-0d1e-4c0e-b83c-c9346f7df10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:32.248579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216734-ba8d-49fe-ab40-bb91cb6819af None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:32.337640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:32.374962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:32.376568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.377094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.377618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8/groups/31acad1dc881426d9df99f2d9d15d444/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.388896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f621ffc69d648c492a664e7b87b08d8, group_id=31acad1dc881426d9df99f2d9d15d444, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:32.391832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:32.445185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 207/395] 10.222.0.102 () {58 vars in 1447 bytes} [Thu May 26 16:26:31 2022] PUT /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8/groups/31acad1dc881426d9df99f2d9d15d444/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:32.474040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 189/396] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:32.536989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:32.588140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959817-ca17-4a09-a6c2-bfe424ff7e67 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.588826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959817-ca17-4a09-a6c2-bfe424ff7e67 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.589340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7959817-ca17-4a09-a6c2-bfe424ff7e67 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.591094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 190/397] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:26:32.597546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.597546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.597546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.618605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:32.619827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:32.722527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:32.766636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8811c-a361-45b5-8191-e150eece4028 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:32.772806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 191/398] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:32 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:32.826196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:32.827250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:32.827536 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:32.827817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:32.833445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:32.857606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:32.873189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:32.874205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:32.875003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:32.875618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 208/399] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:32.887204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:32.970443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:33.069581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad0206-3a37-4a8c-9e01-8562313f1820 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.074880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c2456-77de-4d82-871b-d73f600bcf0f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.139495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.142275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.143181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.144435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.157214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.158542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.159352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.159923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.161451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:33.162250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:33.172405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ad5c3-7b40-4f8e-a961-a4d0f43f7239 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:33.172660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-eb971d31-af23-4e51-b3d9-2b2abff14251 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:33.176077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:33.178119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 192/400] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:33.179851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f5f0-1da8-4583-a5fc-a6910800e56c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.182013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f5f0-1da8-4583-a5fc-a6910800e56c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.182013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0f5f0-1da8-4583-a5fc-a6910800e56c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.182013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 193/401] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:33.189393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0f5f0-1da8-4583-a5fc-a6910800e56c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.195904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 209/402] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:32 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:33.198449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.198970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.199470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.233354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:33.235941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:33.244951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:33.355759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 210/403] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:33 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:33.361205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.363078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0f5f0-1da8-4583-a5fc-a6910800e56c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.429335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:33.447686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.448356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.448677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.448961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.449747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:33.450062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:33.451527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:33.462393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 194/404] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:33.463300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.536476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d07fc0-fe0c-4cf1-9a75-99d44a08c74e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.582359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.583399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.583534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.583987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.589471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:33.591057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:33.593669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 211/405] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:33.594753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.647722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e732-f599-4637-8ab0-ba48aca65c64 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.650464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:33.720634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.722294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.722793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.723984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.747366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:33.757819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161dd54-f769-4e24-84c3-aa79c071a46b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:33.763912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:33.765971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:33.767409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:33.770892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:33.772914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 195/406] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:33.775392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.810208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.811302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.811681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.812009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.813577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:33.815262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:33.821958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 212/407] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:33.821958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.928826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96ab88-85ec-4a7c-993d-87679c0600ac None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:33.967553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:33.968549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:33.968815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:33.969095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:33.970364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:33.971825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:33.974044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 196/408] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:33.974718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:33.980864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3d527-18a7-447f-a6f2-2054ea9c7729 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.008434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:34.026630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.027959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.028776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.029066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.029853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:34.030170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.031568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.046678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 213/409] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:34.047790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:34.089553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:34.121263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c758b00-5476-46d7-bb3e-cb5c0af340a2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.165531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90e229-e378-4c86-a9fc-16acf933b3ee None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.169209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.170332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.170840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.171322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.172764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.174557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.182303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 197/410] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:33 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:34.183674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:34.206504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.212893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.213184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.213523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/groups/31acad1dc881426d9df99f2d9d15d444/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.216007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, group_id=31acad1dc881426d9df99f2d9d15d444, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.218215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.241832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 214/411] 10.222.0.102 () {58 vars in 1447 bytes} [Thu May 26 16:26:34 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/groups/31acad1dc881426d9df99f2d9d15d444/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:34.243657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:34.314458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:34.325050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4555d6-279e-4260-9517-c2c7b79e505c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.377217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:34.384795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02a21e-5d59-4a79-a1c0-98220346a9b9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.402133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.404477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.405481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.406284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] PATH_INFO: `/v3/groups/5dfab4c2f550462fa05bee63f665756f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.409345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] RBAC: Authorizing `identity:get_group(group_id=5dfab4c2f550462fa05bee63f665756f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.412775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.417200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 198/412] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:34 2022] GET /identity/v3/groups/5dfab4c2f550462fa05bee63f665756f => generated 230 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:34.428123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:34.432951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.433770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.434059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.434336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc/groups/31acad1dc881426d9df99f2d9d15d444/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.440439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c938ae8603546fd9fc6812352c34ffc, group_id=31acad1dc881426d9df99f2d9d15d444, role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.440439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.484415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 215/413] 10.222.0.102 () {58 vars in 1447 bytes} [Thu May 26 16:26:34 2022] PUT /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc/groups/31acad1dc881426d9df99f2d9d15d444/roles/4adbf210244243b7a5724f918f6b9a5a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:34.689300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d9fa0-4579-4399-a4d7-f67137532ffc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:34.767371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:34.769489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:34.770352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:34.771116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] PATH_INFO: `/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:34.773849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] RBAC: Authorizing `identity:get_project(project_id=6d72a14f73b1482981ce0e1b7a09f3ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:34.776882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51123f-33f6-4804-8200-b212ad366799 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:34.780478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 199/414] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:34 2022] GET /identity/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea => generated 345 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:34.787408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:35.029695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90485276-0ef9-4e66-8969-4e9e218d46b8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:35.120053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:35.122324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:35.122834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec1575-318f-4df7-b75e-f3c79438140c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:35.123131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec1575-318f-4df7-b75e-f3c79438140c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:35.123418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec1575-318f-4df7-b75e-f3c79438140c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:35.123945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:35.124694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] PATH_INFO: `/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea/groups/5dfab4c2f550462fa05bee63f665756f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:35.125286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 200/415] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:35.130581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:35.130915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:35.131147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:35.132137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d72a14f73b1482981ce0e1b7a09f3ea, group_id=5dfab4c2f550462fa05bee63f665756f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:35.135549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:35.163756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:35.166826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:35.194613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 216/416] 10.222.0.102 () {58 vars in 1447 bytes} [Thu May 26 16:26:34 2022] PUT /identity/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea/groups/5dfab4c2f550462fa05bee63f665756f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:26:35.235405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:35.333334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 201/417] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:35.395436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:35.439514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:35.584178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56ee7-e78f-4e05-bd5d-43a2b1b19e82 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:35.631416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:35.632256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:35.633125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:35.633403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:35.646270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:35.655251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:35.656212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:35.657098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 217/418] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:35.666152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:35.898022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b11fa-3844-4917-ae2c-bdfd69958d5c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:35.970970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:35.972139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:35.972759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:35.973272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:35.974686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:35.975254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:35.978229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:35.999991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 202/419] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:36.005010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:36.159998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:36.206637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b946b-b2fe-494a-b373-06451d46eb75 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:36.297103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:36.298664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:36.299412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:36.305975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:36.478544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:36.481878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b30c54-dff7-43ab-86bb-973eabda5d16 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:36.658506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:36.695483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 218/420] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:26:36.704467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:36.756910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:36.795619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165d061-b460-4274-8c6c-08ff6c0dd412 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:36.796711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165d061-b460-4274-8c6c-08ff6c0dd412 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:36.797491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165d061-b460-4274-8c6c-08ff6c0dd412 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:36.805480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 219/421] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:36 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:36.811678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:36.812728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:36.813644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:36.856430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05585b5f-3524-43c5-b406-1e081bc91858 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:36.882368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:36.887169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:36.909829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:36.912490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:36.913356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:36.914183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:36.920444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:36.920444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:36.925116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 203/422] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:36 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:36.941500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:36.985531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 220/423] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:37.010855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:37.131146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ea350-2f00-4961-af02-8243dc2549a9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:37.148796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:37.173764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:37.174743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.175132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.175593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.189184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:37.198012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:37.199214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:37.200284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:37.203144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 221/424] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:37.211782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:37.254156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:37.289457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23d76a-bfd1-4ec8-ae9d-93c7c57b8415 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:37.334587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f90f9-8a8a-44ac-b2fc-6f949ae3fb31 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:37.374269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:37.375261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.375732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.376147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.377297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:37.377874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:37.379431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:37.389175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 222/425] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:37.395066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:37.397142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:37.398555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.398841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.399261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.405369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:37.407236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:37.408823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 204/426] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:36 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:37.421582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:37.436774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:37.520792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcf2d-8f5d-4a3f-b3eb-c4ffb1badb57 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:37.560825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:37.561900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.562430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.562918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.579713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26428d-885d-4f9d-8d29-b3172d97bfdf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:37.620920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:37.621629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.621921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.622259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.623240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=6f621ffc69d648c492a664e7b87b08d8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:37.623571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:37.625136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307236-c772-48c0-97eb-59e870522ca6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:37.636441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 205/427] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 613 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:37.636441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bbc6-408e-488b-a4e1-1944407735e8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.636441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bbc6-408e-488b-a4e1-1944407735e8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.636441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001bbc6-408e-488b-a4e1-1944407735e8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.636441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 206/428] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:37.643397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:37.643711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:37.643977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:37.670363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:37.671887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:37.681218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:37.682461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:37.723337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:37.733385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:37.826283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 223/429] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:26:37.830936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 207/430] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:37 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:37.832341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:37.854520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.031843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923022b-506c-4968-a3d3-16e747d8e694 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.056080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eaaf80-48c2-4d65-9923-c71e8cbac10d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.066983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.076147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.077109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.077397 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.077606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] PATH_INFO: `/v3/projects/6f621ffc69d648c492a664e7b87b08d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.078947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] RBAC: Authorizing `identity:get_project(project_id=6f621ffc69d648c492a664e7b87b08d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.080681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f02be-968e-47b5-ba79-9d1c13349f7e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.082661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 224/431] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/projects/6f621ffc69d648c492a664e7b87b08d8 => generated 299 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:38.086649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eeeab-90b0-4956-8ddd-c183d03892df None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.087460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eeeab-90b0-4956-8ddd-c183d03892df None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.088343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eeeab-90b0-4956-8ddd-c183d03892df None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.090444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 225/432] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:38 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:38.092017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eeeab-90b0-4956-8ddd-c183d03892df None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.096093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.096957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.097250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.097530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.109674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f0879bab-e257-4ad8-8955-38b1b77c4bb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:38.117896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:38.118844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 16:26:38.119624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:38.124008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 208/433] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:38.125404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.125781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.126093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.143464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:38.144712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:38.157248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.240655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 209/434] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:38.240655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.277712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eeeab-90b0-4956-8ddd-c183d03892df None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.327734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.328966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.329371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.329762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.331833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.333811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.336826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 226/435] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:38.337966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.386945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71424162-8bf1-4636-9820-843495ec4c41 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.421990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.429852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.431037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.431577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.432046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.433535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:38.434088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.436997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.452702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 210/436] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:38.454283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.468433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe9e39-057e-4028-bcba-1be83db4b72a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.473983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.514236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.515278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.515680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.516088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.528677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f864bf70-c4be-422c-a04d-ed0bc2d90e13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:38.537851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:38.540358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 227/437] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:38.549612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2353c8-eafc-43a4-af37-32fc6aca1136 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.550318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2353c8-eafc-43a4-af37-32fc6aca1136 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.550318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2353c8-eafc-43a4-af37-32fc6aca1136 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.550318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 228/438] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:38 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:38.550318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2353c8-eafc-43a4-af37-32fc6aca1136 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.594586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81183248-109d-4568-bbd8-f99949d96d15 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.640003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.641086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.641547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.642027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.642977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=43b33b457be34a02b9be138701888988, scope.project.id=6f621ffc69d648c492a664e7b87b08d8) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:38.643484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.646013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.654669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 211/439] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=6f621ffc69d648c492a664e7b87b08d8&role.id=43b33b457be34a02b9be138701888988 => generated 613 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:38.655724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:38.694476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2353c8-eafc-43a4-af37-32fc6aca1136 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.737963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.756866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.757796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.758272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.758727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.803969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:38.869467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc42ac21-84ac-4a7b-bf0c-9235cfff2332 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:38.876443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.877111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.937818 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:38.938985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.940436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.940436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.941567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:38.942137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:38.945756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833fe32-d358-4b12-b6e4-2b3ffac2d0c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:38.956159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 212/440] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:38.958080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:38.958587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:38.959522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:38.979211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:38.980701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:39.047030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 229/441] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:38 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:39.051823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.111512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.137039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 213/442] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:38 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:39.138644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.240597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e352ad9-516d-4601-a298-ebe3c9ce099a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.265915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.323208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:39.323208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:39.323604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:39.323604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:39.338469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfedeb2-7d6e-4183-af70-f9a93c9e8e6d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.427516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:39.428296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:39.428655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:39.429034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:39.430270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:39.431889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:39.433691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 214/443] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:39.434479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.442783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:39.446207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:39.492101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.558336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c496f0-d4c5-4789-918d-7aa5e39c4c47 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.591652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.598495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:39.599296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:39.599578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:39.599854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:39.611440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:39.618086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 230/444] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:39.619612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:39.619772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:39.627726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 215/445] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:39.629359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.741877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf2ed5-e193-4100-8e9b-2791ce585c93 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.776473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.777354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861a7f3-ba55-4cbd-aa8f-074c658d7918 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.789488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:39.790405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:39.790694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:39.790971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:39.792178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:39.793686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:39.795350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 231/446] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:39.796147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.835058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:39.836980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:39.837441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:39.837821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] PATH_INFO: `/v3/projects/5c938ae8603546fd9fc6812352c34ffc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:39.839809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=5c938ae8603546fd9fc6812352c34ffc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:39.842416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:39.845152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 216/447] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/projects/5c938ae8603546fd9fc6812352c34ffc => generated 303 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:39.846288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:39.940971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc71c-d02a-4a7d-be49-992f4fa34125 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:39.941479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:39.997471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7fd0b-72e5-4c00-8e34-1d6becc2a3d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.008708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.009826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.010315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.010813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.012296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:40.012892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.015589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.037263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 232/448] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:40.037263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:40.037624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.037624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.037624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.037624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.039223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=43b33b457be34a02b9be138701888988, scope.project.id=5c938ae8603546fd9fc6812352c34ffc) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:40.039537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.041090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.047951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 217/449] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:39 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=43b33b457be34a02b9be138701888988 => generated 613 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:40.048903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:40.150615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:40.192202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb009158-a19b-40ad-ae91-aefc4c7694f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.223033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:40.239147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.239962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.240115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.240443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.253143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a64aa-13ed-4e72-8071-68aa73049779 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.320419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921141-e612-4446-beb2-92b781a085db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.321052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921141-e612-4446-beb2-92b781a085db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.322193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921141-e612-4446-beb2-92b781a085db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.322193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68921141-e612-4446-beb2-92b781a085db None admin] PATH_INFO: `/v3/groups/31acad1dc881426d9df99f2d9d15d444` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.323851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921141-e612-4446-beb2-92b781a085db None admin] RBAC: Authorizing `identity:get_group(group_id=31acad1dc881426d9df99f2d9d15d444)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.327359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68921141-e612-4446-beb2-92b781a085db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.331248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 233/450] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/groups/31acad1dc881426d9df99f2d9d15d444 => generated 227 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:40.335285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921141-e612-4446-beb2-92b781a085db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:40.346635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.348265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.509315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68921141-e612-4446-beb2-92b781a085db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.521741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 218/451] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:40.529282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:40.559357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:40.561349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:40.580475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.581482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.581913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.582342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.583709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] RBAC: Adding query filter params (group.id=31acad1dc881426d9df99f2d9d15d444, role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=5c938ae8603546fd9fc6812352c34ffc) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:40.584188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.587130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.597323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 234/452] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/role_assignments?group.id=31acad1dc881426d9df99f2d9d15d444&scope.project.id=5c938ae8603546fd9fc6812352c34ffc&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 613 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:40.675591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76e036-caf8-4ad4-a406-7392ed919ba9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.742724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.744299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.744809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.745319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] PATH_INFO: `/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.747873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] RBAC: Authorizing `identity:get_project(project_id=6d72a14f73b1482981ce0e1b7a09f3ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.750905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.754679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 219/453] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/projects/6d72a14f73b1482981ce0e1b7a09f3ea => generated 345 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:40.764322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:40.926004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3bfe2-6add-4c7f-9140-4b6d05ee81f2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:40.977972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:40.979309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:40.979714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:40.980105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] PATH_INFO: `/v3/groups/5dfab4c2f550462fa05bee63f665756f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:40.981640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] RBAC: Authorizing `identity:get_group(group_id=5dfab4c2f550462fa05bee63f665756f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:40.983334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b14a7-2990-416a-b505-de2d21025dbd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:40.985583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 235/454] 10.222.0.102 () {56 vars in 1185 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/groups/5dfab4c2f550462fa05bee63f665756f => generated 230 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:40.993298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:41.108294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:41.118169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c99cf3-20fc-4ae5-be7a-d97db12cce54 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:41.155303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:41.155954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:41.156246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:41.156558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:41.157403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] RBAC: Adding query filter params (group.id=5dfab4c2f550462fa05bee63f665756f, role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6d72a14f73b1482981ce0e1b7a09f3ea) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:41.157726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:41.159311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f56761-12ec-4a8a-a728-629c1aeb40f4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:41.166173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 220/455] 10.222.0.102 () {56 vars in 1381 bytes} [Thu May 26 16:26:40 2022] GET /identity/v3/role_assignments?group.id=5dfab4c2f550462fa05bee63f665756f&scope.project.id=6d72a14f73b1482981ce0e1b7a09f3ea&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 613 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:44.121709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65146-bd7c-4d20-84cc-2a7eefd5d408 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:44.122612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65146-bd7c-4d20-84cc-2a7eefd5d408 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:44.122612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a65146-bd7c-4d20-84cc-2a7eefd5d408 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:44.123781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 236/456] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:44.129512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:44.130397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:44.130397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:44.162374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:44.162374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:44.271268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 221/457] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:44 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:44.297526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65146-bd7c-4d20-84cc-2a7eefd5d408 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:44.389505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:44.425404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a65146-bd7c-4d20-84cc-2a7eefd5d408 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:44.465414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:44.466248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:44.466538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:44.466820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:44.480312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:44.481861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:44.501921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:44.503498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:44.505400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:44.505400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:44.505400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:44.505400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:44.505400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 237/458] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:44.510372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:44.613617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:44.639640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd80d1-65af-47d3-9ddb-104f2fe186e4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:44.724959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:44.726645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:44.727116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:44.727588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:44.729029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:44.729585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:44.732401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3e7f-ed8f-452e-9d54-c4839b8c1e8f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:44.750271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 222/459] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:44.755927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:45.000898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219434f-535b-4ea1-a454-67f57449d71d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:45.015358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:45.089505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:45.090705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.091218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.091723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.093186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:45.096081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6374489-9f46-45b3-9282-0ef64108db91 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:45.131642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 238/460] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:44 2022] POST /identity/v3/users => generated 247 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:45.274421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67d7f-81bc-4605-85d9-6d3176203d3b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.274948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67d7f-81bc-4605-85d9-6d3176203d3b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.275332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee67d7f-81bc-4605-85d9-6d3176203d3b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.278113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 223/461] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:45 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:45.284449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4c1e-5307-41c8-9597-13a57dc26d0d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.284744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4c1e-5307-41c8-9597-13a57dc26d0d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.285174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b4c1e-5307-41c8-9597-13a57dc26d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.317214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a16b4c1e-5307-41c8-9597-13a57dc26d0d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:45.318460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a16b4c1e-5307-41c8-9597-13a57dc26d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:45.447568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 239/462] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:45.485893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee67d7f-81bc-4605-85d9-6d3176203d3b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:45.656775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b117-c6eb-45fb-b31c-9257dd373d7a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.656964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b117-c6eb-45fb-b31c-9257dd373d7a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.657251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b117-c6eb-45fb-b31c-9257dd373d7a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.659007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 240/463] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:45.665063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.665399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.665643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.691178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:45.694775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:45.728103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee67d7f-81bc-4605-85d9-6d3176203d3b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:45.784429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:45.785258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.785595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.785942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.787185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 241/464] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:45.799398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:45.801120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:45.811333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:45.814331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:45.826795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:45.828547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:45.830273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:45.830273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:45.830273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:45.830273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:45.830273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 224/465] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:45.836231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:45.847049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:45.938448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1679d36-a7b9-4c13-b7ec-a35edc1c9853 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:45.978459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:45.979363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:45.979714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:45.980060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:45.992435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:45.994027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:46.013474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:46.014636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:46.015681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:46.015681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:46.015681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:46.015681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:46.018143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 242/466] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:46.026551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:46.112205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b58e-8cf3-4395-8ecc-e4eed903bc0e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:46.125347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:46.158009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859da47-94c8-4533-89b1-0b3d6eed8b7d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:46.177243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:46.178345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.179405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.180003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.181326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:46.181796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:46.184385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecdc5e-26a2-4066-a93d-c07eb73d7e5a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.201703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:46.202836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.203322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.203752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.204676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:46.205143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:46.206609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 225/467] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:46.206887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd16ef4-2526-4102-9319-ef89a7ff3012 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.217876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc6f-0409-4ecc-9f2e-287c0307568c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.218352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc6f-0409-4ecc-9f2e-287c0307568c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.218826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcc6f-0409-4ecc-9f2e-287c0307568c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.221368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 226/468] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:46 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:46.226414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcc6f-0409-4ecc-9f2e-287c0307568c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:46.226957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 243/469] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:46.228891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.229517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.230226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.250680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:46.252455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:46.340132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 244/470] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:46.346306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:46.351661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:46.417780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcc6f-0409-4ecc-9f2e-287c0307568c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:46.451416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:46.459103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:46.459691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.462668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.462668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.462668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:46.463204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.495188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 227/471] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:46 2022] POST /identity/v3/users => generated 250 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:46.496250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:46.539020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672af44-bbbb-470a-9385-fadfb7c0482b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:46.614729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:46.616677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.617631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.618462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.620251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:46.623706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.678854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 245/472] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:46 2022] POST /identity/v3/users => generated 249 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:46.774847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ac9d-e251-4684-9c6b-5be14dfb5935 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:46.824839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:46.889946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:46.891255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:46.891774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:46.892253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:46.916452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:46.919238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5fe6b21e-86ea-4ffe-ba0a-4d2ec1e6d5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:46.955399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:46.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:46.957213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:46.957213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:46.957213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:46.957213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:46.958218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 228/473] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:46.965026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:47.160988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515e1ef-5134-4d87-b2c8-72c1acae97c2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:47.204833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:47.250804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:47.251867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:47.252409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:47.252899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:47.253852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:47.254399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:47.255993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:47.290683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 246/474] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:47.296888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:47.298217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5f2b-9684-4ec9-bb7a-aad050c4f24f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:47.298731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5f2b-9684-4ec9-bb7a-aad050c4f24f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:47.299234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5f2b-9684-4ec9-bb7a-aad050c4f24f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:47.303255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 229/475] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:47 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:47.316001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:47.318410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:47.318574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:47.354011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:47.355736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:47.532519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d177f-af42-4f45-a4ba-960ee77e4289 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:47.564785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 230/476] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:47 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:47.601564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:47.620917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:47.622576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:47.623352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:47.624119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:47.625642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:47.628595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:47.677506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 247/477] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:47 2022] POST /identity/v3/users => generated 249 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:47.727288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1dbe5-99f4-4fa9-b620-11c043764726 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:47.731463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:47.768944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:47.769637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:47.769934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:47.770192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:47.770963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:47.772916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:47.781414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:26:47.781414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:26:47.781414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [parameters: {'id': 'a94c93cc9d624ca185a9cb1145333500', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:26:47.781414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 26 16:26:47.801186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return ref.to_dict() May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:26:47.803136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:26:47.807661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:26:47.815045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:26:47.818649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:26:47.822072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': 'a94c93cc9d624ca185a9cb1145333500', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:47.825784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 16:26:47.834407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:47.838023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 231/478] 10.222.0.102 () {60 vars in 1136 bytes} [Thu May 26 16:26:47 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:47.838222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:47.942471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:48.091745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a2dcc-6e72-4763-adfe-a279e518aaeb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:48.171359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:48.173966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:48.174803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:48.175494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:48.201423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-34b0e4e9-1a7b-4554-9214-66fb162d945a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:48.226783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:48.228533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 16:26:48.230017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:48.235217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 248/479] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:26:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:48.244016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:48.456943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04611379-70bb-46b9-ad45-f4ed69a7f9b7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:48.516839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:48.517929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:48.518421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:48.518912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:48.520295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:48.520856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:48.524087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b897a5-f8a8-4143-b902-d40c32557330 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:48.544770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 232/480] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:48 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:49.427697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596f5e1-fbd5-42e9-bbb3-77d884127864 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:49.429771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596f5e1-fbd5-42e9-bbb3-77d884127864 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:49.430548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596f5e1-fbd5-42e9-bbb3-77d884127864 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:49.433347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 249/481] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:49 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:49.440079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:49.441012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:49.441779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:49.476088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:49.479226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:49.512455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:49.638487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 233/482] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:49.678197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596f5e1-fbd5-42e9-bbb3-77d884127864 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:49.864165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:49.877298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596f5e1-fbd5-42e9-bbb3-77d884127864 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:49.918974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:49.919705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:49.919992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:49.920270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:49.933892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1146cb49-b1a9-4126-8a08-e3aea114126f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:49.942082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:49.943008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:49.943806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 250/483] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:49.953576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:50.074634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4ff3-e094-451f-8527-2fb9620cfb50 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.074928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4ff3-e094-451f-8527-2fb9620cfb50 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.075346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf4ff3-e094-451f-8527-2fb9620cfb50 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.077605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 251/484] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:50 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:50.086442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.087380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.088162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.137607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:50.139221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:50.153515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8319b9-16b8-4bfc-8910-f91e5a78e0c8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:50.229517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:50.233629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.234133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.234635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.236080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:50.236651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:50.239251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:50.276745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 234/485] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:50.284191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:50.325130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:50.367463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 252/486] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:50.410568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:50.482738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5cf0e-636b-4482-abcf-23675bfe6123 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:50.572106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:50.572980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.573274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.573564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.596603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:50.599617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:50.604837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:50.623417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce4fd1-a1ce-446a-982a-da775125d2f6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0a8970e5-c9d8-4203-b499-8e271b837ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:50.633402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:50.635045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 235/487] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:50.636705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86d6a6-7cc4-4e26-bbc2-e5aef9d10dcb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.637301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86d6a6-7cc4-4e26-bbc2-e5aef9d10dcb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.637301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86d6a6-7cc4-4e26-bbc2-e5aef9d10dcb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.638579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 236/488] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:50.643878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86d6a6-7cc4-4e26-bbc2-e5aef9d10dcb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:50.700697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:50.702701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.703369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.703963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.726983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:50.732012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5d7f5638-0c7b-4024-93ef-e40cfd80bcde None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:50.748966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:50.750105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:50.751051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:50.754730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 253/489] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:26:50.757718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.758362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.758972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.789717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86d6a6-7cc4-4e26-bbc2-e5aef9d10dcb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:50.792878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:50.795189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:50.840089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:50.841263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:50.841805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:50.842269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:50.843766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:50.844463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:50.846470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:50.863751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 237/490] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:50.865115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:50.929861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 254/491] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:50.931513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.060403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.092982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922b729-e2a2-4c8e-b076-cfa9d91774fa None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.093516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b471890-70c7-4d4e-94c4-170ce0f351ee None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.134839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.145248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.146116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.146503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.146877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.148113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:51.148113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.149758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.164410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 238/492] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:51.164410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.182439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.183623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.184039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.184390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.195740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.197674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:26:51.223901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:51.226422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 255/493] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:26:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:51.228194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.358939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4534a4-4694-44de-ab61-c3df255c7acc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.376718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb217f1e-d4cb-4971-b2d7-fbd5e7a294b0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.398815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.399704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.399991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.400265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.413516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:51.421797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:51.423536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 239/494] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:51.425070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.446533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.448242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.449029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.449920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.455443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.469176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.470841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.486743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:51.492428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:51.493886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 256/495] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:51.495699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.578775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e93eb-6c76-47ae-afd3-ab54b57e61bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.634457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.635487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.635950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.636457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.638091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:51.638782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.641131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8fa77-1e82-411f-af9d-06dbb1688c07 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.677807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db6287-83c5-45e0-bb17-a81541ff85a5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.703327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 240/496] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:51.705637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b72-e8a6-436d-b3a0-d1b6c5cfde7e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.706136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b72-e8a6-436d-b3a0-d1b6c5cfde7e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.706623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e8b72-e8a6-436d-b3a0-d1b6c5cfde7e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.712858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 241/497] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:51 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:51.712858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8b72-e8a6-436d-b3a0-d1b6c5cfde7e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.750584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.751512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.751917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.752422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.753399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:51.753922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.755616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.766563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 257/498] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:51.767993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:51.841003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.862843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e8b72-e8a6-436d-b3a0-d1b6c5cfde7e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.876954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:51.921202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48277d-9f9c-4eec-9045-b08d790b681b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:51.923999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.925074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.925534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.925932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.927235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:51.927747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:51.930362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db32bd9-aab8-4b04-bd9e-04beb8cea2cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:51.954414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 242/499] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:51.954414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.954414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.954414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:51.975638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:51.976975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:51.982832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:51.983811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:51.984309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:51.984823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.058136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 243/500] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:52.058994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.098859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.101485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.167130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.197933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.206170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f97bd-5cc8-4fe0-9823-3f08380958e7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.228620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 258/501] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:52.229896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.254668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.255728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.256069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.257020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.269032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.270532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:52.288763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:52.290018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:52.291060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:52.291060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:52.291060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:52.291060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:52.292549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 244/502] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:52.293978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.355014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1c5a5-ac1b-4a74-96d5-8f1090deccf6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.390320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.391133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.391411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.391687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.401849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.403586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.409731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb9316-3001-4eda-8576-8a2f0c6916e5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b4d34748-602e-4647-8514-305d5522f24c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:26:52.419659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:52.421565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:26:52.423234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:52.424810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 259/503] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:52.427529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7917a-5180-49ac-8f05-a2b1a9ecdf3c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.428836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7917a-5180-49ac-8f05-a2b1a9ecdf3c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.429335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7917a-5180-49ac-8f05-a2b1a9ecdf3c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.431245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 260/504] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:52 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:52.432115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7917a-5180-49ac-8f05-a2b1a9ecdf3c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.447052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.451632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.452476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.452770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.453055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.465985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:52.475669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:52.476874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:52.477868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:52.478477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 245/505] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:52.478931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.494984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.572109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7917a-5180-49ac-8f05-a2b1a9ecdf3c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.615619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff9497-9589-4ade-9fdb-346b4ddfbe27 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.618362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.619632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.620069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.620552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.637862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.640625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.660407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.661210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.661574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.661947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.662794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:52.663188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.664731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea52850-977c-42a8-ac50-4daf3e9cd08b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:52.672922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:52.674522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 261/506] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:52.676186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.684426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 246/507] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:52.685749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.686037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.686316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.704142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:52.705760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:52.757653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.802271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:52.803198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17f6bd-5804-4c7c-81c0-eaf5aa1f8a82 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:52.809837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 247/508] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:52.810883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.847510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:52.848420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:52.848906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:52.849328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:52.851161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:52.851622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:52.853248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:52.893746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 262/509] 10.222.0.102 () {56 vars in 1144 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:52.894503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:52.952873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae57e43-94c3-4db7-a019-c59598e0f752 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.013209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.014219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.014724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.015083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.015867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:53.016175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.017835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.027971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 248/510] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:53.029633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.048421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7815dea-e497-4b1f-a4cf-43b89aef19b4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.085863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.103804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.109627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.110407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.110802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.111179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.112019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:53.112513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.114113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.127471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 263/511] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:53.128328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.167150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b93fb7-1671-4362-9ef9-7cababcaa615 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.225992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.227153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.227600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.228054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.240850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.242919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:26:53.270341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:53.272695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 249/512] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:53.281464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.286815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8039504-1acf-4279-aaca-6d32c7d3ff66 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.332264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.333398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.333745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.334107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.347877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.349771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:53.377669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:53.378634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:53.379505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:53.379505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:53.379505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:53.379505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:53.380036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 264/513] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:53.381998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.410390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e090f38-853f-4e0e-8c1b-03f7bd4a7400 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.432488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.440206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.450866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.451644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.452004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.452455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.528015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.529913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.563682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f615b69-db45-4ce2-a4f7-93e45aa41c8f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.603664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.604487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.604780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.605061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.617012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.618504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:53.637473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:53.639425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 265/514] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:53.641376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.667237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 250/515] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:53.668468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.703500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.751375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:53.772997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf84c57-c7d0-4435-8c75-671164c55ef1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.814190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537133-871d-4829-a36e-0868cff19c9a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.818964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.820335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.820850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.821302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.831548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.833286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:26:53.852540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:53.854390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:53.856467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 266/516] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:53.857548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:53.857720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.857863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:53.857863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:53.857863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:53.858511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:53.858918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:53.860772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:53.882528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 251/517] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:53.883911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:53.994646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83182dc-31a7-4f81-bbc4-8aa4d4067dcc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:53.994878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.023008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a05a4-ef52-470b-9e2d-c1914642a2ea None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.039844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.040665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.041036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.041409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.042286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:54.042702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.044312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.059082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 267/518] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:54.060148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.064738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.069496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.070323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.070732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.071138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.072115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:54.072571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.074389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.096414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 252/519] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:54.096414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.194460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e8d214-9ba3-4a40-8ee1-59ebac8ec188 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.238422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.239353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.239735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.240096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.240507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133d89-5870-4f4c-becc-44eb8ce11b3c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.257609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.259984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:54.283487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:54.285366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 268/520] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:54.287134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.292733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.294234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.294703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.295111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.296017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:54.296426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.298048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.314775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.328064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 253/521] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:54.329275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.369492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.423550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467998a-ed33-4c9d-8531-4693a4f89c3a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.453772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768882e-7a25-4ccd-bf79-cd7ba96559b9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.466607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.467350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.467704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.468046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.494683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.495365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.495648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.495935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.496695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.498370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.522514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 254/522] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:26:54 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:26:54.523291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.582996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.586400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.620827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.688730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:54.714850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac617b57-bfb8-46ab-83b9-b7a8362218fe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.776781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.778419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.779272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 269/523] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:54.782168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.782645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.782645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.794123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.797261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:26:54.819694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:54.821782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 255/524] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:54.823581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:54.931698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e69dd-3c62-4372-a1d6-16a8cadf4847 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:54.980853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:54.981741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:54.982153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:54.982759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:54.983671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:54.984252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:54.986224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.007090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 270/525] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:55.007090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.026593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8134d734-e972-41c0-afde-b96fc9cc9e42 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:55.031160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:55.050237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:55.081099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:55.082005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:55.082309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:55.082640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:55.083569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:55.083922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:55.085654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.093243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 256/526] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:54 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:55.094801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.232879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cc4a8-d519-4331-b684-aee842f770aa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:55.301711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:55.303576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:55.304093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:55.304662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:55.328633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:55.331708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.341403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568aec5d-9bdd-4bdc-b8ac-4c7ddab4d41b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:55.369589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:55.371180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:55.372833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:55.372833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:55.372833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:55.372833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:55.372833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 271/527] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:55.374317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.422263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:55.424084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:55.425475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:55.426488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:55.428903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:55.429953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:55.434002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.480408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 257/528] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:55.480408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.523972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:55.571113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:55.603032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addcfa31-4119-425e-85e6-0e06b028ae45 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:55.686423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:55.687776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:55.688662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:55.689079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:55.705434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:55.708230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.716448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b176cd-7614-4e82-b5cb-933d2ffd7381 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:26:55.738006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:55.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:55.741488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 272/529] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:55.742404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.804158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:55.806253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:55.807066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:55.808206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:55.810535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:55.811823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:55.815882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:55.844995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 258/530] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:55.848125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:55.971159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22902bf-4031-4898-a597-3b503dfef11d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:56.028985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:56.049076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:56.051504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:56.052239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:56.053572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:56.069954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:56.081807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4e1a3-e4a6-487e-9f1c-0a9b5a455f4d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:56.152140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:56.153884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:56.155035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:56.155761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:56.157612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:56.158429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:56.161735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:56.187914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 259/531] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:56.189837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:56.198609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:56.201570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:56.401816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 273/532] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:55 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:26:56.401816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:56.406484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510d0a6-67f6-4bc7-958e-269fbbbe5141 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:56.451667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:56.487153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:56.488673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:56.490059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:56.490704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:56.509308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:56.512581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:26:56.547454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:56.549288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:56.550830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:56.555440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 260/533] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:56.557387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:56.595049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:56.625403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832daa94-1c44-4361-be72-62a57ddbcd1d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:56.693326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:56.694915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:56.695383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:56.695845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:56.697415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=1a13a32aadcf43d681c5aeef7c9e1fcb) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:56.697923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:56.700524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:56.711606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 274/534] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:56 2022] GET /identity/v3/role_assignments?user.id=1a13a32aadcf43d681c5aeef7c9e1fcb&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:56.712946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:56.779753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f37ffa-79d6-4839-b901-1a12e84a874e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:56.846349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:56.847649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:56.848099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:56.848583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:56.870348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:56.872872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:56.914864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:56.916601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:56.918417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:56.918417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:56.918417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:56.918417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:56.923266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 261/535] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:56.929661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.020715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:57.033171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7856a-9527-49d8-a263-c5871666b7ab None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.053712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:57.087139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.087830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.088120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.088448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.089783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:57.090102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:57.092132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32286f2b-6105-488b-9043-a1f2a2633999 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:57.118830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 275/536] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:26:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:57.120213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2a2a-f0c7-4ec0-bfeb-f6b1441763e1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.120791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2a2a-f0c7-4ec0-bfeb-f6b1441763e1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.121068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc2a2a-f0c7-4ec0-bfeb-f6b1441763e1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.122767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 276/537] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:57.130556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5a3c7-b7b2-4cc3-9653-f84a4a9c2cf2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.133898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.134191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.134472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.155012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:57.156341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:57.176909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.177584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.177965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.178235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.178983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:57.179297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:57.180865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:57.194623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 262/538] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:57.195544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.312512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c837-6153-4867-9db8-c4129fa43739 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.313402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 277/539] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:57.315351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.341287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:57.354664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.355145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.355439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.355724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.356616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=9ec344b4ce9a4de4b55b6425b75da380) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:57.357012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:57.358438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:57.373761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 263/540] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:57 2022] GET /identity/v3/role_assignments?user.id=9ec344b4ce9a4de4b55b6425b75da380&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:57.374671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.446060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:57.468541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5727e-3928-490c-8b5f-00222731dcc2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.511085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.512355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.512943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.513438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.523050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:57.525152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:26:57.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:57.542549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:26:57.543386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:57.546171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 278/541] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:26:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:57.553586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.674836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92ea4-b299-44a6-be25-824ed7321fae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.739792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.741384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.741906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.742425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.768568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:57.787103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:57.789061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:57.789896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 264/542] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:57.813030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:57.876945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:57.900462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b469a-17d2-49be-bf73-c6e561b2652d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.934420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d395b-025a-4ef6-8de7-ffaa80042c30 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:57.994906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:57.995594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:57.995879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:57.996161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:57.997269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:57.997579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:57.999147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:58.014834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:58.015527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.015817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.016098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.016931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:58.017244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:58.018797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:58.034557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 279/543] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:26:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:58.035347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 265/544] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:58.045577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:58.045849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:58.048755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:58.266454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870af36b-19bc-4562-ba27-786984111bb3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:58.325679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca7107-3899-4351-be92-c6c2e2621e96 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:58.335269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:58.336319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.336841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.337296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.338804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=9dd18deb63da438cb8eee3d8e7daa955) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:58.339313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:58.341944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5ba75-392b-43e6-955d-3461e0bda098 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:58.352357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 280/545] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:26:58 2022] GET /identity/v3/role_assignments?user.id=9dd18deb63da438cb8eee3d8e7daa955&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:58.353728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:58.354846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f4209-e39a-4d16-b159-a1c3695b903d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.355145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f4209-e39a-4d16-b159-a1c3695b903d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.356062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f4209-e39a-4d16-b159-a1c3695b903d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.364423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 281/546] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:58 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:58.368331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.369143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.369746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.422125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:58.428235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:58.439170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:58.441050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.442838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.443976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.478057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:58.482745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:58.530814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:58.531701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:58.532599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:58.532599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:58.532599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:58.532599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:58.535358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 266/547] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:58.541733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:58.604670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:58.632405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 282/548] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 16:26:58.654223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:58.765546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59f2f-8230-4ebc-871a-e76d0f3ff5fc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:58.854517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:58.859311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:58.860272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:58.861274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:58.864714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:58.868882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:58.871971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:58.912629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 267/549] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:58.914720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:58.925169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba24a7d-d14f-4f5e-9979-a4af382d6fdc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:58.975608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:59.011959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:59.013692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.014424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.015215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.048091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:26:59.075808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:59.077810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:59.079340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 283/550] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:59.090856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:59.186341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff58d1-4b71-49b0-8a5b-da2bc00b0f0f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:59.244878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:59.270924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:59.273554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.273725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.274100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.303241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:59.306220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:59.332840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf553fc-7856-4b4d-981e-eb3f9a3f272d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:26:59.341133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:59.342990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:26:59.344667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 268/551] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:26:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:59.348421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:59.405832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:59.407465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.408235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.409026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.410753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:59.411655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:59.415036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:59.432301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 284/552] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:26:59 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:26:59.443993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:59.588297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:59.619877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2261a-5182-46a0-a51a-639f616d5107 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:59.687607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:59.689345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.690178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.691006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.693019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:26:59.694551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:59.697963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dce0da-4db0-411f-b329-8ff33adbe714 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:59.719765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098695a8-7600-4221-8c1c-901289f7c9e1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:26:59.734991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 269/553] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:26:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:26:59.737846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726686c-cd97-4eed-8821-224d21d613f2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.738816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:26:59.739661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726686c-cd97-4eed-8821-224d21d613f2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.741020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726686c-cd97-4eed-8821-224d21d613f2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.745017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 270/554] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:26:59 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:26:59.746616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726686c-cd97-4eed-8821-224d21d613f2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:26:59.762990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:26:59.763811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.764102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.764411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.777001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:26:59.779052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a971c50c-0e0c-4a13-98f7-2c023a9a0011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:26:59.798469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:26:59.800457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:26:59.803470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:26:59.803470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:26:59.803470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:26:59.803470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:26:59.803470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 285/555] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:26:59.805211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:26:59.806292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:26:59.806292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:26:59.825555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:26:59.826866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:26:59.949156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 286/556] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:26:59 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:26:59.951129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:00.030392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726686c-cd97-4eed-8821-224d21d613f2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.098268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:00.100086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.100829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.103021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.153012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:00.183841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:00.189856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc2143-55a4-4d85-a61d-bef85d245a37 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.233634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:00.236956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:00.263461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:00.264824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.265433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.266050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.267792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:00.268481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:00.271519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:00.296967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 287/557] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:26:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:00.298606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:00.409061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 271/558] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:26:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:00.409941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:00.507027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c64ba7-b6c4-4ef5-b01d-884a6041d346 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.516135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:00.594191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:00.595797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.596425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.597027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.623064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:00.642948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e4e88-c984-4597-8f4f-6cefe4ab94c5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:00.643249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:00.645431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:00.647016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:00.652282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 288/559] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:00.654024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:00.711023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:00.732897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:00.734238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.734723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.735201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.750934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:00.753225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:00.783052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:00.784181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:00.785220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:00.785765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 272/560] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:27:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:00.787003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:00.861035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fade44-23a4-438c-a9f0-a62d8b44e783 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.928342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:00.929721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.930228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.930905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.938096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d824432-ef4d-476e-b177-ac11d4206bf7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:00.941131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:00.955205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:00.957997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-5dfa6413-ae7d-4850-b96a-b2a1b616bc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:00.990090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:00.991838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 289/561] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2b-0635-4b36-82d0-be39bcd4b016 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:00.994716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2b-0635-4b36-82d0-be39bcd4b016 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:00.995427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace87a2b-0635-4b36-82d0-be39bcd4b016 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:00.997562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 290/562] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:01.000123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a2b-0635-4b36-82d0-be39bcd4b016 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.007805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.008784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.009199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.009605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.010520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:01.010959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.012594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.026513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 273/563] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:00 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:01.027825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.140122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.175145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace87a2b-0635-4b36-82d0-be39bcd4b016 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.200280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ddc53-7a22-4fdb-91ec-6130a9ab8a44 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.223945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.225192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.225485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.225768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.226727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:01.227046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.228586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5dc76d-3b3e-4ddb-a310-a96fdc54942f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.249588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 291/564] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:27:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:01.250990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161885-3f29-4cf3-93cf-32d1ee0c2662 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.251286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161885-3f29-4cf3-93cf-32d1ee0c2662 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.251572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2161885-3f29-4cf3-93cf-32d1ee0c2662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.263948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.265071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.265568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.266067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.267429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:01.267984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.270437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a2161885-3f29-4cf3-93cf-32d1ee0c2662 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:01.270661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.272193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a2161885-3f29-4cf3-93cf-32d1ee0c2662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:01.299600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 274/565] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:01.299600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.343155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.348650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 292/566] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:01.358940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccdc8-3e8b-4ca6-9ad2-d3a691a65933 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.358940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccdc8-3e8b-4ca6-9ad2-d3a691a65933 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.358940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cccdc8-3e8b-4ca6-9ad2-d3a691a65933 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.358940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 293/567] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:01 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:01.358940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cccdc8-3e8b-4ca6-9ad2-d3a691a65933 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.440533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.463349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706c7b6-5ec6-4fab-b4bb-52409cbd8eb9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.500946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.501889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.502264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.502656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.505150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cccdc8-3e8b-4ca6-9ad2-d3a691a65933 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.514168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.515642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:01.534890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:01.536696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 275/568] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:01.539651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.558149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.559895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.560419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.561110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.578850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.580579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-51934293-7163-4c5b-9701-71f71b9b4c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:01.601003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:01.602514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 294/569] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:01.604210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.604940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.604940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.621696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:01.622896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:01.660826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.685311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd3118-0354-4756-8502-aa9cd8936c26 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.704488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 295/570] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:01.705790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.728683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.729493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.729783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.730056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.737997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.739615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:01.756842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:01.758606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:01.760906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:01.763058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 276/571] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:01.764019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.774945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.851439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232bbfb-5600-4a33-b774-56453cea0209 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.888117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8ee67-364b-4fce-9152-072f19f720b5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:01.890099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.890911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.891196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.891475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.905237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:01.913145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:01.915114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:01.916476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 296/572] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:01.917838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:01.931967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:01.932680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:01.932970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:01.933255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:01.933990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:01.934304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:01.935731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:01.943649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:01.949973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 277/573] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:01.950836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.062756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04703f71-b8b8-481b-b713-9c24f6af2d27 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.080296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f69ef-8080-4923-b0db-6c1085701e81 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.082978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.107360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.108258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.108649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.108992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.124152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:02.128153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.128959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.129387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.129768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.130751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:02.131156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.132705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:02.133290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:02.135835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 278/574] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:02.138056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.155166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 297/575] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:01 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:02.156315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.222426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.281281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc4719-28f3-4c5f-8e8c-49dd5aa6a8ea None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.288541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d381ac-e522-47e9-a934-1c2e8d5ed9c9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.329291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.330165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.330658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.331026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.331878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:02.332287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.332882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.333554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.333843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.334073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.334253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.334917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:02.335231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.336717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.343921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 298/576] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:02.345366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.352567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 279/577] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:02.354615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.382215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.478783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b454a-0f82-4d8a-99d6-7bee9e890fb0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.484356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa39749-35ab-47f9-886c-cd8345ab1e3a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.503331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.522869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.523678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.524109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.524522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.525389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:02.525790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.527330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.536102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 280/578] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:02.536342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.537478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.538114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.538616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.539088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.554170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.556972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:02.585021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:02.586927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 299/579] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:02.589210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.665526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d8618-5dc2-4125-9d53-3a5bbe3f0aa6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.696704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.706652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.707460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.707749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.708029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.715788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.716451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8db23-5850-4aa2-9eb3-db8cd4482f94 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.717324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:02.734057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:02.735919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 281/580] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:02.737863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.767090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.768126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.768516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.768866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.786505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.788250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:02.789714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:02.820752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:02.822572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 300/581] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:02.824298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.870298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532480-a579-41fb-9f5c-075afd8c31d9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:02.923795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:02.924864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:02.925327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:02.925798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:02.927554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=34368002fec64283a184b548b246f345) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:02.928069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:02.930232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:02.949787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 282/582] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/role_assignments?user.id=34368002fec64283a184b548b246f345&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:02.949787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:02.985627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432400e-de93-46e1-9ded-29e19735ceb6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.040190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.041255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.041726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.042196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.046420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.058610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.060905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:03.083091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:03.085705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 301/583] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:03.088823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.144145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760969c-3359-4c22-b8a0-42a991685776 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.149466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.200123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.201207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.201697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.201978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.202846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:03.203162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.204684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.231766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 283/584] 10.222.0.102 () {56 vars in 1144 bytes} [Thu May 26 16:27:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:03.234391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.288524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f859c3-cab0-4fad-8f4d-47db9d8fe6d6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.348703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.350160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.350616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.351044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.352064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:03.352601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.354330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.370444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 302/585] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:03.372316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.406785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24e63-6dd0-4469-a676-a5c42aa64ad3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.469770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.470868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.471301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.471732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.472652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.473047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:03.473537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.475964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.497342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 284/586] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:03.498774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.549535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.556270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbef36-a05e-4b74-af9e-e21f944fb75b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.608136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.609354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.609970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.610443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.611444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:03.612196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.614462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.642052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 303/587] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:03.642052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.689444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acd166-7d17-479c-9507-31f19afb8274 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.742319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.743221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.743482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.743772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.758333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.759935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:03.788029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:03.790065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:03.791828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:03.791828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:03.791828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:03.791828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:03.796659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 285/588] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:03.799651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.802837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23b655-6b11-4d4a-b015-5af96ba17449 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:03.815322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.861141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:03.862923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:03.863532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:03.864121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:03.891171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=bf8a03a9bb9848c0a51808883cb9f929, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:03.893916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:03.902761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:03.914587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 304/589] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:03 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:03.915514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:03.961561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b64544-f810-4234-b087-44fb5f4ed867 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.028330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.029669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.030456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.030965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.046245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.049570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.051127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18d2c2-00b1-4098-b902-b845b178989f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:04.080414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:04.082243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:27:04.084274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:04.088943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 286/590] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:04.090926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.101108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.101938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.102227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.102508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.111845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.113276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:04.131429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:04.133322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 305/591] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:04.135212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.185989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:04.306284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b4a60-dd2b-49fc-8ab3-d82b6b9b9018 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.361376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00abca7-f1b0-421e-80c0-c880e0034294 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.381300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.383206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.383722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.384240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.386280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:04.387216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.390337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.394450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:04.426041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 287/592] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:04.428426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.438181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.439245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.439704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.440194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.441836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:04.442394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.446089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.488501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 306/593] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:04.490696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.650556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca1feb-b674-4790-8341-6e9fd08a3181 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.679338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:04.731287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.732447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.732958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.733465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.733572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11126808-18dd-47dd-8b10-266efdcff3ed None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:04.735125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:04.735689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.738767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.780429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 288/594] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:04.780429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.813835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:04.815837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:04.816743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:04.817584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:04.832255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:04.836125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:04.864312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:04.866060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:04.867760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:04.877332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 307/595] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:04.879436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:04.889890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:04.997402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7565408-d78d-45ef-9091-b49320c35ae4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.062478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.063838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.064333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.064986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.069924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7590c2-b173-4bc2-af34-5045782e2ad4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.088308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.091667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:05.130852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:05.132758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:05.134977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:05.134977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:05.134977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:05.134977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:05.140895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 289/596] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:05.141694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.142454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.143261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.144164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.144705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.157188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:05.167509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.170442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:05.205836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:05.214154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 308/597] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:05.221733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.360612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418cd3-bc2d-4486-bcdf-dd7a2eae7372 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.366062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:05.391446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e35e2-f92c-4805-9091-1b0ea78ba857 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.428775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.429465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.429755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.430034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.430867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:05.431187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.432748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.456669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 290/598] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:05.456669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.467243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.468467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.469006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.469519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.470865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:05.471376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.473505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af106779-248a-4ff6-83b8-46a3537f1f4d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.496614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 309/599] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:05.499023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248639-43b8-4b15-8ee8-31a3204a4f87 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.499515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248639-43b8-4b15-8ee8-31a3204a4f87 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.500000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248639-43b8-4b15-8ee8-31a3204a4f87 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.502898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 310/600] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:05 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:05.504082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248639-43b8-4b15-8ee8-31a3204a4f87 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.572806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:05.647856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5d9eea-3cae-4ae1-84e3-81fac4fab43b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.652692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248639-43b8-4b15-8ee8-31a3204a4f87 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:05.698723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.699786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.700262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.700698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/1a13a32aadcf43d681c5aeef7c9e1fcb/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.715439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:05.716643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.717161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.717720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.718915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:05.719472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.720452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=1a13a32aadcf43d681c5aeef7c9e1fcb, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:05.722094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.722263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72db8f2-12fe-4294-8ef4-d4e3516787d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:05.741324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 311/601] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:05 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/1a13a32aadcf43d681c5aeef7c9e1fcb/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:05.743186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.749722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 291/602] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:05.752889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:05.753853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:05.754707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:05.788509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:05.791696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:05.833035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:05.964473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 292/603] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:05.964473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:05.990328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:05.998574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433fbc1-7837-4e73-829b-9c551185f84c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.065002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.066468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.066941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.067406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.080505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.083223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:06.110328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:06.112018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:06.113760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 312/604] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:06.114747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.197866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658fd2b-e347-4b1c-820e-aecf3e3362c5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.277465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.279822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.280698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.281784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.295528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.298231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.319664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174c83-1fe2-439d-937d-31afe7d7bff0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:06.327777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:06.328774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:06.329655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:06.330719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 293/605] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:06.332235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.356288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:06.381735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.383112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.383616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.384096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.405381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:06.421900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:06.422948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:06.423777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:06.428939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 313/606] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:06.430852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.466999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:06.489190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fce0-b9ab-4a57-852b-5fa8d058eac2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.536082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.536844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.537482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.537666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.538460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:06.538841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.540305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.557662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 294/607] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:06.558905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.593355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8f18c-c509-4cf6-b24a-550926f4af44 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.636253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.637300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.637761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.638039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.638865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:06.639176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.640970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.658838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 314/608] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:06.660193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.699761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:06.747047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe02d3d-db39-4c19-9e1a-1d4e1b4c2533 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.767235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:06.798293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2e1a-085f-4708-9f02-ebda9f43a182 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:06.808954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.810005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.810583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.811069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.812338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:06.812869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.815226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6ec40-900c-422a-968d-171f92b0594a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.829275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 295/609] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:06 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:06.831400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da0a97-ee9b-4d0e-9915-f825f2c472ce None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.831848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da0a97-ee9b-4d0e-9915-f825f2c472ce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.832288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da0a97-ee9b-4d0e-9915-f825f2c472ce None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.836937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 296/610] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:06 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:06.837911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da0a97-ee9b-4d0e-9915-f825f2c472ce None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:06.859801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:06.861330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:06.861803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:06.862297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/9ec344b4ce9a4de4b55b6425b75da380/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:06.880862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=9ec344b4ce9a4de4b55b6425b75da380, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:06.882332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:06.908650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 315/611] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:06 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/9ec344b4ce9a4de4b55b6425b75da380/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:06.910314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.042409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da0a97-ee9b-4d0e-9915-f825f2c472ce None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.100314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.102051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.103636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.104177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/9dd18deb63da438cb8eee3d8e7daa955/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.114901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:07.130900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8f1c6-dff3-431f-9ce5-a0cd4411f2a9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.133946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=9dd18deb63da438cb8eee3d8e7daa955, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:07.135780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f80891-1ed1-420b-8c4b-d3e08411e74c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:07.158856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 297/612] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:06 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/9dd18deb63da438cb8eee3d8e7daa955/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:07.161882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.162468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.162965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.188204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:07.189659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:07.193507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:07.210281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.211971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.212740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.213748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.237702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:07.243209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:07.288984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:07.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:07.292712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:07.292712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:07.292712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:07.292712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:07.293141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 298/613] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:07.301096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 316/614] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:07.306385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.320267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.444505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6367f8-aeb7-40a5-b2a2-c7cfd55a96ad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.466238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:07.502095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.503540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.504455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.506173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.507949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:07.508351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:07.511522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:07.542039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 299/615] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:07.543035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.582508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8562f07-138d-46b7-a242-bbc068ad095e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.645568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.647036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.647496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.647940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.669107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:07.677865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:07.678905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:07.681324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 317/616] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:07.686774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92065e-ec00-47ca-b67e-c7176f5de7f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.688094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.751500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.752744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.753242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.753724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.772221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:07.774109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:07.793335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:07.799571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:07.800903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:07.801853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:07.804958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 300/617] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:07.811459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.854202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:07.870351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb246a-5e49-439f-9690-bfeb6663d648 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:07.933270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:07.934481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:07.934976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:07.935273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:07.936749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:07.937976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:07.939819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:07.956430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 318/618] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:07.965131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:07.997433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520445-8753-4c5b-b88a-2b5874d3aa39 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.066066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.067215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.067779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.068286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.069877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:08.070442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.073213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.111638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 301/619] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:08.117238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.168186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ed7a8-da75-4d02-8da8-453fcd1852be None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.170104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:08.215003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.215823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.216153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.216393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.228027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.229571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:08.250954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:08.252011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:08.252925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:08.252925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:08.252925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:08.252925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:08.252925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 319/620] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:08.261863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.363402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:08.391638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f474-f70e-4e22-8542-1a13b8b764d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.449737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.450794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.451253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.451672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.473227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.477349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.511410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10130a-4625-453c-a6df-ca786c4d8a0a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:08.518305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:08.519600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:08.520958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:08.520958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:08.520958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:08.520958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:08.520958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 302/621] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:08.526608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.566065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.566739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.567023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.567301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.568628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:08.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.570340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.584319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 320/622] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:08.590087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.608801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:08.715630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd121db2-b4cf-4a49-ae64-4e61f5bba586 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.756655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.757643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.757973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.758256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.767603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.769256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:08.785505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:08.786819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:08.787808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 321/623] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:08.789223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719a4d9-6f2a-44a2-94f1-836546a84f95 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.793457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.883394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:08.895771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.896883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.897387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.897887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.899192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:08.899569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.909830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.911591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ebae4-1f1f-40be-ab90-f40686f1f095 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:08.949444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:08.950126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:08.950407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:08.950682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:08.951541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:08.951708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 303/624] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:08.951859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:08.953394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:08.960924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:08.974623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 322/625] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:08.975019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:08.981467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.098189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2e15a-5575-437a-82ae-5c4e3bdc4435 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.129280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7a7acb-0ff6-4bfe-97a9-6828a30241b1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.137905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:09.144224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.145130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.145427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.146270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.176012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.177710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.178334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.179038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.188629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.191714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f5998aec-99e8-45da-bccb-62e4f073b0d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:09.223883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:09.225838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:09.227826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:09.238084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.238084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115b0d4-1788-4fe9-bc8c-745108614418 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.238944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 304/626] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:09.241402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa489c-9f5c-400d-a050-1b4798f429a3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.242109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa489c-9f5c-400d-a050-1b4798f429a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.242878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa489c-9f5c-400d-a050-1b4798f429a3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.245259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 305/627] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:09.246194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa489c-9f5c-400d-a050-1b4798f429a3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.354064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:09.402803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 323/628] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:27:09.409738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.410084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.410454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.415895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa489c-9f5c-400d-a050-1b4798f429a3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.429201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:09.430304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:09.460195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:09.467113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.468076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.468805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.469229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.470175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:09.470741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.493049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 306/629] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:09.495252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.530146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 324/630] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:09.535054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.656172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0af18-1285-428f-9d0a-5a4e9484ea5e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.668664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb90774-b479-47e6-98e0-6e0d41534fdd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.692622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:09.706289 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.707757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.708734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.709233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.711521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.713019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.713019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.713493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/34368002fec64283a184b548b246f345/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.724714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.726975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.731164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=34368002fec64283a184b548b246f345, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.732928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaedb359-e317-4038-a06a-ac36863a3960 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:09.748296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:09.749458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:09.750532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:09.750532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:09.750532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:09.750532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:09.756658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 307/632] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:09.756850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 325/632] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:09 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/34368002fec64283a184b548b246f345/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:09.758346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.758771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28c72-3bc2-47e3-9971-d9e0ba11b0d1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.759095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28c72-3bc2-47e3-9971-d9e0ba11b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.759414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f28c72-3bc2-47e3-9971-d9e0ba11b0d1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.762495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 326/633] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:09.763391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f28c72-3bc2-47e3-9971-d9e0ba11b0d1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.785381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:09.900829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ddbf7-991d-479a-a102-cc36973cdc93 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.912568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f28c72-3bc2-47e3-9971-d9e0ba11b0d1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:09.950277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.951789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.952304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.952875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.955786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:09.956765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.956880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.957204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.958741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:09.959053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:09.960613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e40c23-b583-4930-9273-bdf5c6571e63 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:09.967773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:09.974956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 327/634] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:09.976276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:09.976651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:09.976934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:09.977473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:09.978392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:09.979223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:09.985255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 308/635] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:09.988111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:09.997918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:09.999408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:10.035509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.104485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 328/636] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:10.105428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.108991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.123095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dabb57-a841-4887-b4b8-046340ddf693 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.178420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.179804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.180437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.180733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.189635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.191181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:10.206465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:10.207418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:10.208330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:10.208799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 309/637] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:10.211868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.251748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025bd8a-4e0a-4df0-8134-544c11096947 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.293732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.294688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.295079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.295473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.296355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:10.296803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.298384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.315135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 329/638] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:10.315135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.326320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.330374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf50fbb-2a46-4fc0-9f4e-b98d5b9af72a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.379383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.380188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.380516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.380797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.392544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:10.401183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:10.402134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:10.402968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 310/639] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:10.403646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.418072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.467233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317861e2-f0e4-437c-9774-613deb6d0b43 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.507994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.508701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.508989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.509266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.510065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:10.510376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.511817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133c21-d1f4-4983-afa4-b3e6123e882d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.526177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 330/640] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:10.526550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0480e-b918-4914-b308-c22b6d548a73 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.526842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0480e-b918-4914-b308-c22b6d548a73 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.528838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0480e-b918-4914-b308-c22b6d548a73 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.532436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 331/641] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:10 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:10.533828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0480e-b918-4914-b308-c22b6d548a73 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.546311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f9a28-6098-4896-8b27-38233cec420d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.586133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.586941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.587239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.587523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.599536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.601057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:10.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:10.629602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 311/642] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:10.631404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.640881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.687405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0480e-b918-4914-b308-c22b6d548a73 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.724808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:10.736996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.737678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.737968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.738246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.739002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:10.739316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.740733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f999c0-82fe-436d-947d-68b1a7fa8daf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.749758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 332/643] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:10.750990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.751284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.751564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.761859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0546b51-867b-4e1f-9417-b730a7c34d9e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:10.786612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:10.788354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:10.801070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:10.801926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:10.802207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:10.802489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:10.803454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:10.803763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:10.805383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:10.824914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 312/644] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:10.836412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.906770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 333/645] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:10.908909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:10.979292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:11.041626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552b17d-d24e-4693-af33-7845d4a9b94b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.050152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c9e9f3-39e8-4395-af2d-9eff48038f58 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.072306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:11.095505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.096736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.097175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.097625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.110009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:11.111828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:11.118622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.119809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.120320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.120872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.122481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:11.123003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:11.125764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:11.134580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:11.136219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 334/646] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:11.138229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.158649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 313/647] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:11.160088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.327153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a551db-f30a-4a20-a89d-f82a292554bf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.360711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1148b-ba2e-4fd5-8be0-7fa7ca3073a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.394223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.396193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.397371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.398294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.420403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:11.438942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:11.440704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:11.442285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:11.443464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.443464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.443464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.443464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.443915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:11.443915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:11.445729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:11.448036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 335/648] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:11.448847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:11.451884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.476421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 314/649] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:11.476421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.518040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:11.687543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a60cb-ae9d-45c0-9248-50226530cb12 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.702523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5c41-4cb4-4ec4-bfda-dc1bf92c7990 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:11.766761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.768123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.768650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.769133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.772002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:11.774264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:11.775053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:11.775807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:11.777566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:11.778404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:11.781564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:11.783972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:11.787822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:11.800302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 315/650] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:11.803207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:11.819383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:11.821619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 336/651] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:11.823400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:11.941104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.004337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.030982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2493c-1658-47e2-9557-3bcfcd33f4c6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.044699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbed3aa-15d5-4369-9e06-895011ce7b59 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.106574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.107595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.107950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.108454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.109006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.110173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.110974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.111768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.126804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.130832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.131661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.134441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:12.160619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:12.162633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 16:27:12.165292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:12.174888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 316/652] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:12.174888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c033a015-a6ad-4ecc-be5e-4c27f2cc8832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:12.175617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:12.178813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 337/653] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c62a-dc96-43d6-9b4e-d38fa070aed1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c62a-dc96-43d6-9b4e-d38fa070aed1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c62a-dc96-43d6-9b4e-d38fa070aed1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.183677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 338/654] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:12 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:12.185678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c62a-dc96-43d6-9b4e-d38fa070aed1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.338638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c62a-dc96-43d6-9b4e-d38fa070aed1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.381167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.382011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.382341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde11d0-ddd1-47c6-85a8-0c818302211f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.382545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.383019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.383896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:12.384335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.386098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.398415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.404363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.409951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 339/655] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:12.411494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.429130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.429939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.430232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.430533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.431336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:12.431645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.433130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27402b30-15c4-4834-a207-785dc8b80b9b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.453167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 317/656] 10.222.0.102 () {56 vars in 1144 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:12.454472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.454752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.455036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.472700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:12.474377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:12.547990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52eaf-6ac9-4750-aeaf-621759e98f85 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.560438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 318/657] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:12 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:12.560438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.596667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.597606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.598323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.599371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.601033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:12.601505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.603133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.628477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 340/658] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:12.629693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.693822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.711485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a133a0-ff3c-4032-916e-18d418bc6840 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.714104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:12.759745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a4d85-4651-4238-93fa-387f7bc11d3a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:12.764872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.766117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.766602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.767074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.780000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.782458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:12.809055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:12.810888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 319/659] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:12.813612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:12.826669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941c43-c625-47a2-b881-843e39da379a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:12.828037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941c43-c625-47a2-b881-843e39da379a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:12.828767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941c43-c625-47a2-b881-843e39da379a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:12.829231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56941c43-c625-47a2-b881-843e39da379a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:12.948705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941c43-c625-47a2-b881-843e39da379a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:12.951300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56941c43-c625-47a2-b881-843e39da379a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:12.976463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3a411-1939-414a-b8f4-5d998fab57c5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.031739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.032999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.033439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.033912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.048015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.050946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:13.065263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:13.067375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 320/660] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:13.069128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.112288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.133418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 341/661] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:12 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:13.135248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941c43-c625-47a2-b881-843e39da379a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.236407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7dce-0197-4f78-97a7-0341b3892638 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.279412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.280491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.280928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.281262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.284309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56941c43-c625-47a2-b881-843e39da379a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.325433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.326468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.326939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.327400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.328924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:13.329419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.331877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.352615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 342/662] 10.222.0.102 () {56 vars in 1142 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:13.353485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.373382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.374685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.376467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.407202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.464699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e5c3-0b8d-4654-a38d-ed08fe98ab04 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.490096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 321/663] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:13.490877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.505159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.505887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.506279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.506595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.507462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:13.507805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.509256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a541a7-d979-441d-9701-462ae7b26455 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.518258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 343/664] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:13.520960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9295-6dbf-470f-a376-bcaf778f4116 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.521452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9295-6dbf-470f-a376-bcaf778f4116 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.521933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca9295-6dbf-470f-a376-bcaf778f4116 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.524335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 344/665] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:13 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:13.525657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca9295-6dbf-470f-a376-bcaf778f4116 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.612709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b932df-5e19-4c86-8b04-a562ca9eb3ba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.616545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.641589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.643804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca9295-6dbf-470f-a376-bcaf778f4116 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.653621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.654417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.654697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.654970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.666374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.668140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.683295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.683968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.684251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.684587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:13.687892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:13.689657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 322/666] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:13.690759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.764702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.766791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.804600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3af7-ffbd-4a92-9148-400f6d252ee5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:13.842384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:13.843200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.843485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.843761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.855709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.856211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:13.857963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:13.881684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 345/667] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6ee0d81e-3e46-49f7-bc4a-2644dd969d0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:13.882537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:13.884183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:13.886007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:13.886007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:13.886007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:13.886007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:13.886715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:13.886847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 323/668] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:13.886847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:13.886847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:13.886847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:13.905616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:13.906834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:13.931920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:13.988301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 324/669] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:13.989772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.003256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386ac2d-67ca-4c1b-abc9-bc88b9465da0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.040599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.041325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.041611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.041891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.054142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.055609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:14.075162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:14.076973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 346/670] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:14.078765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.132177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.138120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9442a4-9448-459b-80ce-2a7a5a131f48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.199448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.200778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.201271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.201769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.203158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:14.203719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.206253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.208772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d5e1e-c6cc-47f6-b653-5276e6b35ad7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.229417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 325/671] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:14.231563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.256161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.256994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.257283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.257555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.259561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.269886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.272756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:14.307984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:14.309705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:14.311432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:14.311432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:14.311432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:14.311432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:14.312625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 347/672] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:14.313795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.365572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcca19-e024-4ba9-8b9b-aa8c3a17acda None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.418154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.418966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.419394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.419860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.420777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:14.421109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.422588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.428804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.438090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 326/673] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:14.439009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.457852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557619-1bad-46f8-890c-83bb10eb2ee0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.501836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.502658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.502946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.503252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.516037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:14.524013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:14.525908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 348/674] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:14.527319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.547188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.574211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d400c-6d87-40fb-931e-593df8a03dcc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.621882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.622966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.623443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.623910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.625196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:14.625717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.628159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.649497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 327/675] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:14.650961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.679933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd6e3-18ca-460f-9e88-ed235ff4bf18 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.738117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.739997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.740530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.741029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.753544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.756862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.776465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a708e1-cff5-41c6-ba3b-0c2c7cf2c078 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:14.784019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:14.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:14.786245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:14.786676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 349/676] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:14.787859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.792547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.829910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.831066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.831586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.832099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.833564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:14.834127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.836802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:14.850112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:14.864875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 328/677] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:14.864875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:14.911992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3f02c-8362-4b96-9217-9bfce22e3ba2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.978618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:14.979956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:14.980509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:14.980962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:14.993710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:14.993988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118f24-8014-41e5-86e4-780f727eae80 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:14.996476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:15.023611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:15.025478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 350/678] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:15.027889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.035813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.036660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.037099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.037474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.038344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.038747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.040231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.050860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 329/679] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:14 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.052893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.109010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.128707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.155469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f193bd7-a16e-4a59-87f9-cdddc8764eda None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.179767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c628ff3-f620-49eb-9eb2-c41e3e2aa055 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.192939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.193746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.194040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.194309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.207818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.209424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.223977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.224777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.225105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.225427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.226306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.226688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.228274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:15.228821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:15.239555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 351/680] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:15.241460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.244549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 330/681] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.245471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.374656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abdc9a-316b-42a0-8d06-f4ae8a6c8407 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.390515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eec378-6596-46d1-9f0a-367c0e836996 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.413719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.425713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.432213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.433243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.433673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.434090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.442744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.444451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.446705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.447531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.447984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.448471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.449392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.449770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.451395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:15.461844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:15.463089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 352/682] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:15.472706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.474446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 331/683] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.474446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.596174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246eae74-83c6-46d6-bb4e-f62ee8156bae None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.607399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040c253-e275-455a-a4ba-65167c567ba8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.641255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.641968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.642385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.642763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.643829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.644200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.646416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.648236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.649183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.649560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.649945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.662872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.664611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.668973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 332/684] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.669382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:15.686746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:15.687775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 353/685] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:15.688946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.733351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.736769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:15.826032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1139c78-b985-4b48-b5a3-5736b0dc6c16 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.826679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab12c7f-4ab0-44ca-8721-523c8dacb1f0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:15.873274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.874008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.874229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.874508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.875366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=1a13a32aadcf43d681c5aeef7c9e1fcb) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.875680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.877236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.884361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 333/686] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/role_assignments?user.id=1a13a32aadcf43d681c5aeef7c9e1fcb&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.885261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:15.886932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:15.888212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:15.888672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:15.889186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:15.890743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:15.891379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:15.894333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:15.920217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 354/687] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:15.921800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.066426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:16.080656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5492d33-d512-4642-b8e1-323bc18b8107 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:16.086183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437e2e8-6300-423f-a354-762c3b1db4d8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:16.089336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:16.143392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:16.143973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:16.144259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:16.144597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:16.146095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=9ec344b4ce9a4de4b55b6425b75da380) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:16.146362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:16.147992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:16.149802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:16.150926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:16.151426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:16.151918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:16.156682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 334/688] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/role_assignments?user.id=9ec344b4ce9a4de4b55b6425b75da380&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:16.156682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.278645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:16.281576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:16.375514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7b135-8a78-4c8a-90b1-481ccd53fb5b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:16.461616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:16.471401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 355/689] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:15 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:16.474437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:16.474658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.474809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:16.474809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:16.474809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:16.476257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:16.477790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:16.480935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:16.508115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 335/690] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:16.510435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.562300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:16.650767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d85e87-a67d-451f-91a1-d82f91edfacf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:16.677384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd714350-10d1-4f2d-969c-33994a3de95b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:16.720646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:16.721438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:16.721767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:16.722176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:16.738008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:16.739488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:16.743856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:16.745612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:16.746387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:16.747883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:16.750863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=9dd18deb63da438cb8eee3d8e7daa955) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:16.751741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:16.755306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:16.759263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:16.761745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 336/691] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:16.763740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.777971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 356/692] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:16 2022] GET /identity/v3/role_assignments?user.id=9dd18deb63da438cb8eee3d8e7daa955&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:16.780715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:16.923479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:17.023446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0715811f-a965-440b-b71f-06f6ebcf05e2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.039054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:17.107884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6210-0339-4302-849d-d3d85e57d1b1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.109117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.109827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.110119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.110399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.111158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:17.111463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:17.112954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:17.138021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 357/693] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:17.144282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:17.185863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.187309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.187761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.188680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.205440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:17.206957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:17.230124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:17.231166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:17.232117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 337/694] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:27:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 470 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:17.237650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:17.391719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc002d62-a409-42db-9866-b4a5b1a85d0d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.431838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:17.469493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.471701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.472540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.473554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.487893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:17.491453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:17.521392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:17.523040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:17.524817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:17.530064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 358/695] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:17.541221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a9ed0-6a80-4431-a6ab-d9747e9686ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.542719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:17.613005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.614078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.614576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.615059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.616704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:17.617262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:17.619942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:17.656101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:17.672240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 338/696] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:27:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:17.680153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:17.831271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10ea68-d383-4c64-861e-307555908c8b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.869510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac100b04-9994-4b85-861a-34601a380764 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:17.916403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.916403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.916403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.916403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.947791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:17.948825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:17.951930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:17.952362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:17.953233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:17.953562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:17.956341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:17.989663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 359/697] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:17.994785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:18.057302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:18.075871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:18.081643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:18.083333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:18.145454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918290b-116c-4a1b-b901-64c3527b3194 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:18.184092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:18.184805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:18.185097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:18.185370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:18.186189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=34368002fec64283a184b548b246f345) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:18.186500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:18.187943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:18.194780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 360/698] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:17 2022] GET /identity/v3/role_assignments?user.id=34368002fec64283a184b548b246f345&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:18.264139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 339/699] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 16:27:18.270070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:18.386161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1b514-66ae-4c02-baa9-5bcf27fde8c2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:18.388131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:18.427204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:18.427937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:18.428226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:18.428547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:18.442724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:18.444226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:18.471500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:18.473355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:18.475154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:18.475154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:18.475154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:18.475154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:18.475154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 361/700] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:18.482812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:18.664732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:18.675303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1d4ce-04bd-4e9a-a792-84ad1d834bef None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:18.746496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:18.747605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:18.748108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:18.748640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:18.750033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:18.750590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:18.753282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b56b7-3781-4f4b-a455-b2466a41a11d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:18.778053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 340/701] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:18.786692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:18.840836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49181-3bfc-4c36-95a4-34a90e3ddeb0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:18.841346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49181-3bfc-4c36-95a4-34a90e3ddeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:18.841842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c49181-3bfc-4c36-95a4-34a90e3ddeb0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:18.852655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 341/702] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:18 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:18.855163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:18.855643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:18.856126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:18.886996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:18.889101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:19.017349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d10ca4-55a8-490e-b103-28d4ec405467 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:19.061640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 342/703] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:19.093868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033a88-4454-4ead-a015-25f615106324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:19.095644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033a88-4454-4ead-a015-25f615106324 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.096467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033a88-4454-4ead-a015-25f615106324 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.097166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45033a88-4454-4ead-a015-25f615106324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.111557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45033a88-4454-4ead-a015-25f615106324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:19.115185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45033a88-4454-4ead-a015-25f615106324 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:19.121281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-45033a88-4454-4ead-a015-25f615106324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:19.142636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:19.144285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:19.146153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:19.149401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 362/704] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:19.162681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033a88-4454-4ead-a015-25f615106324 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:19.215885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:19.316867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:19.345224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f1fc-8fe4-45f7-9eb7-620664a16f48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:19.415573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:19.417497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.418132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.418758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.420139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:19.422909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:19.451095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:19.452228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:19.453120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:19.454066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 343/705] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:19 2022] GET /identity/v3/services/network => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:19.469228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:19.560222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45033a88-4454-4ead-a015-25f615106324 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:19.676525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:19.677142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.677433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.677719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.678539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:19.678855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:19.680351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e9f5f-6691-45f4-b0dc-299a18a4b608 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:19.736137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec9a32-a9c9-4848-8efd-20126e27a528 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:19.818861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:19.819984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.820499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.820982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.822350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:19.822902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:19.825893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497431d-deb1-40b1-abac-a7127cec46e0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:19.836867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 344/706] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:19 2022] GET /identity/v3/services?name=network => generated 125 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:19.839730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa8b8-6282-4047-9a9c-37349079139d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.840245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa8b8-6282-4047-9a9c-37349079139d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.840987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa8b8-6282-4047-9a9c-37349079139d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.843913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 345/707] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:19 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:19.845538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa8b8-6282-4047-9a9c-37349079139d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:19.866661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 363/708] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 705 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:19.868007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:19.868301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:19.872802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:19.875925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:19.902910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:19.905172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:19.986679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 364/709] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:19.987683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:19.992103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:20.047889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa8b8-6282-4047-9a9c-37349079139d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:20.114911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:20.117297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.118109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.118898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.120528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:20.121311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:20.124104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:20.136114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 346/710] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:19 2022] GET /identity/v3/services?type=network => generated 125 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:20.137935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:20.186994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a506400-ce74-4244-b269-f8a6a8a49a11 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:20.312299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:20.327798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:20.329054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.329585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.330090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.332899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:20.333490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:20.336517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9db65-8b4b-46e7-8cd3-05cda7d05072 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:20.355936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 365/711] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:19 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:20.358543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff4366-80f0-4189-ac24-7503f4dca267 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.358874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff4366-80f0-4189-ac24-7503f4dca267 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.359330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff4366-80f0-4189-ac24-7503f4dca267 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.362712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 366/712] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:20 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:20.369218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad96340-1fbb-4915-b91c-ff6904878931 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:20.380326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.380926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.381496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.417364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:20.419492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:20.442578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:20.444613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.445432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.446221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.461696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:20.464501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:20.525291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:20.533295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 367/713] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:20 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:20.571294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:20.696015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:20.697725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:20.699553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:20.699553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:20.699553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:20.699553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:20.703588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 347/714] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 566 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:20.713480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:20.837233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcfa309-2d2e-4a54-93b2-4d32f7100cef None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:20.876420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:20.877411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:20.877697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:20.877974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:20.879750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:20.881202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:20.896974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:20.898882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:20.900694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 368/715] 10.222.0.102 () {56 vars in 1134 bytes} [Thu May 26 16:27:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:20.913520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:20.972630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46de52c-3dba-4ecb-8936-b52921aaaeba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:21.014298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:21.024293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:21.025034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:21.025353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:21.025635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:21.026378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:21.026695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:21.028211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:21.043502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 348/716] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:21.049441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:21.073954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:21.170018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309b0e9-1b29-4fb4-977f-fa2cfd577951 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:21.232524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a8e92-e03c-4893-b2d4-979392c4868b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:21.250943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:21.251626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:21.251915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:21.252196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:21.252950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:21.253259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:21.255192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:21.270986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 369/717] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:20 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:21.276763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:21.297450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:21.298190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:21.298479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:21.298810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:21.299582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:21.301386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8573cf-af0c-4cb6-b63c-b9b6796e45fc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:21.335431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 349/718] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:27:21 2022] POST /identity/v3/users => generated 255 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:21.463730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd06a4-3411-4fd4-818a-8a2211d806a1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:21.520132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:21.540236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:21.541787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:21.542514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:21.543087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:21.544730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:21.545506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:21.547431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7efdc9-be26-43c2-9adb-598afb332ecf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:21.564453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 370/719] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:21 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:22.086651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ac6f-436a-4467-beab-710e43f67e2d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:22.087060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ac6f-436a-4467-beab-710e43f67e2d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:22.087957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386ac6f-436a-4467-beab-710e43f67e2d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:22.091401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 350/720] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:22 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:22.097462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:22.098903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:22.099687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:22.127181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:22.128994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:22.220550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 371/721] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:22.256836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386ac6f-436a-4467-beab-710e43f67e2d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:22.321260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:22.397918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386ac6f-436a-4467-beab-710e43f67e2d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:22.448329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:22.449569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:22.450171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:22.450658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:22.463802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:22.472212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:22.473332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:22.474258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:22.477455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 351/722] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:22.483382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:22.626469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df422f-8623-472b-bc63-bf0cc2bfa3e5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:22.652038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:22.669548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:22.670597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:22.671207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:22.671716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:22.672763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:22.673275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:22.675109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:22.686316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 372/723] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:22 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:22.693403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:22.819350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90e6be-417f-485c-bf57-545b9e63ab59 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:22.829079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:22.865665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:22.866521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:22.866809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:22.867089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:22.880197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:22.881844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-915e77e0-227b-4cc7-b205-0865f4895690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:22.902610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:22.903580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:22.904585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:22.904585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:22.904585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:22.904585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:22.904585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 352/724] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:22.911743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.075084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e18aa3-5bd3-400a-a268-e92ac35a40d1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:23.083464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfe7-e131-4d80-b0ad-b26d9451dffa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.083877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfe7-e131-4d80-b0ad-b26d9451dffa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.084111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52adfe7-e131-4d80-b0ad-b26d9451dffa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.088100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 353/725] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:23.094530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e328b7-d10c-4405-8fe0-3ac252c2c4f9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.095021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e328b7-d10c-4405-8fe0-3ac252c2c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.095488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e328b7-d10c-4405-8fe0-3ac252c2c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.136066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:23.136789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.137083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.137366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.138116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:23.138426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:23.139849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:23.141860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-71e328b7-d10c-4405-8fe0-3ac252c2c4f9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:23.143857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71e328b7-d10c-4405-8fe0-3ac252c2c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:23.153888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 373/726] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:23.161487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.290559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:23.350721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 354/727] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:23.350721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26331-f3dc-4779-b540-d95914478af2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.350721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26331-f3dc-4779-b540-d95914478af2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.350721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb26331-f3dc-4779-b540-d95914478af2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.354042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 355/728] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:23 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:23.356572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.356752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.357008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.378974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:23.378974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:23.404689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aaa44-41f1-48d5-bd26-73b7ad95d6bc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:23.445112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:23.446209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.446640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.447056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] PATH_INFO: `/v3/users/swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.456631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:23.458728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:23.479321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:23.490070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:23.491064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:23.491707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 356/729] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:23.491707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.495216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 374/730] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:23.501599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.511619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:23.603512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3073ef-bf8d-4b9c-9c97-a81bf3b7904c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:23.631800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9c5d6-916e-43c2-9526-a99aa81defff None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:23.633695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:23.641735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:23.642415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.642705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.643103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.643723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:23.645221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:23.668528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 357/731] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:23 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:23.669832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.736456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:23.737600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:23.739695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:23.740256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:23.742774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:23.743295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:23.746069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:23.793870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 375/732] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:27:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:23.802457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:23.881459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:23.952802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1fc35-6aa1-4aca-a571-57bc824f11eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.005805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2c6d6-ae9b-47b4-b2a7-e6cc01a7452e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.020690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:24.022062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:24.022561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:24.023066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:24.044885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:24.054824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:24.055891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:24.056408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:24.056899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:24.062348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:24.063333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:24.064157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:24.064845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 358/733] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:24.077651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:24.097200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:24.166872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:24.169870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:24.269911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74e19-10f9-49f9-9fec-fe2d848b0837 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.350906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 376/734] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:23 2022] GET /identity/v3/auth/tokens => generated 899 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 16:27:24.356851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:24.383068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:24.384344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:24.384840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:24.385380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:24.386465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:24.388919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:24.390594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:24.402324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:24.413619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 359/735] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:24 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:24.422938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:24.481836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:24.534787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5c544-310a-40a0-8145-6c1c2aacb52c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.590851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:24.592756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:24.593573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:24.594383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:24.618232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:24.620347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:24.647207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf4263-522c-4560-bd89-f315436bdbeb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:24.658582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:24.659547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:24.661188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:24.661188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:24.661188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:24.661188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:24.661188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 377/736] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:24.668054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:24.719907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:24.721404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:24.726379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:24.727037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:24.754766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:24.757520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:24.792221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:24.794169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:24.796446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:24.796446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:24.796446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:24.796446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:24.796446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 360/737] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:24.804992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:24.934676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea73417-688e-4c42-aa54-c63c161e2481 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:24.953808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:24.954077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:25.002088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.003170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.003706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.004205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.005206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:25.005771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.007591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aabdc0-ff84-4d4e-862f-6935916b3e89 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.029364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 378/738] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:25.032230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758bd35-ed10-4419-afb7-1cf3f2e892c1 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.033121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758bd35-ed10-4419-afb7-1cf3f2e892c1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.033886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758bd35-ed10-4419-afb7-1cf3f2e892c1 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.037672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 379/739] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:25 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:25.038889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758bd35-ed10-4419-afb7-1cf3f2e892c1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.075947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f9cb9-a9d9-4e91-855e-fb0f6e77d429 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:25.134928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.135960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.136256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.136567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.137324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:25.137638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.139358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8308bf-375d-4ba9-bdd3-cba22a333781 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.155922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 361/740] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:25.157902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.158192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.158777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.179072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:25.180297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:25.231815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758bd35-ed10-4419-afb7-1cf3f2e892c1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:25.269696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 362/741] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:25 2022] POST /identity/v3/auth/tokens => generated 899 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 16:27:25.270598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.289932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.291985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.293003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.293582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.308057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.310682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-621e419f-4e27-42ad-afc1-a50c70764893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:25.336778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:25.338459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:25.340178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 380/742] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:25.343383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1637-8863-4d83-825d-5e75f42d4afb None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.343383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1637-8863-4d83-825d-5e75f42d4afb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.343383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba1637-8863-4d83-825d-5e75f42d4afb None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.348834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 381/743] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:25 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:25.350219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1637-8863-4d83-825d-5e75f42d4afb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.351646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:25.388006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:25.477855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666a33d-1f5d-43bc-a3cc-e599501ea073 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:25.496855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba1637-8863-4d83-825d-5e75f42d4afb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:25.541854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.542909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.542909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.543159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.543792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.545232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.546883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.548243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.548813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.549262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.563559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.566335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.576514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 382/744] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:25 2022] POST /identity/v3/services => generated 252 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:25.576514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7ac702d7-6682-437a-9dda-4f1c10c836d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:25.607464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:25.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:25.611835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:25.623733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 363/745] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:27:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:25.626843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.627624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.628333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.665271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:25.666541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:25.745467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:25.772611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e445264-48f4-4e86-abf4-74b5fcf20d56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:25.809087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 364/746] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:25 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:25.810684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.836170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:25.836966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:25.837395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:25.837620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:25.838712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:25.839701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:25.840800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:25.857676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:25.858224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 383/747] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:25.859413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:25.991975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b5ac-60fd-4bd8-bafb-21a111319e8d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.013733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d275-3614-4379-bb60-76c91148e920 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.036026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.036887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.037171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.037448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.051965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:26.060065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:26.061144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 384/748] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:26.063060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.067291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:26.087443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.089249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.089416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.089857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.091717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:26.092287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.095221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.132763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 365/749] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:27:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:26.141368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.191878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bdafa7-5580-498c-9cc1-c822f5c242fa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.235665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.236794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.237299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.237784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.238919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=34368002fec64283a184b548b246f345) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:26.239450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.241180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.253755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 385/750] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/role_assignments?user.id=34368002fec64283a184b548b246f345&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:26.255119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.333107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:26.354007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fdf93-d6c7-40b8-8216-3eb603d0de79 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.377027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:26.415734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751fdf4-3d1b-4373-a6c2-252a79da3dab None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.426258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.427838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.428630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.429340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.431284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:26.432177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.435514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.460407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.460407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.460407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.460407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.461455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 366/751] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:26.467799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.487435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.489333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:26.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:26.536304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:26.538100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:26.538100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:26.538100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:26.538100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:26.538100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 386/752] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:26.541808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.659790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e2c3a-dfea-4d03-8845-7443d67108d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.715317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.716532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.716974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.717402 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.739844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.741622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:26.780860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:26.781845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:26.782730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:26.782730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:26.782730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:26.782730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:26.784822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 367/753] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:26.793463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:26.799223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:26.825611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5378edb-1088-4f02-b188-b2c4c5f6598b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:26.872921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:26.900672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:26.902343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:26.903134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:26.903901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:26.907002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:26.907858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:26.910953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:26.943016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 387/754] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:26.953011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.013945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c6ad1-ea4f-4491-bf56-08eee57e12ce None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.064027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.064730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.065016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.065295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.066658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:27.067031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.068449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.096995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 368/755] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:27.103741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.165456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da5380-5d29-49ef-9027-05f3aff935ec None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.223126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.223956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.224247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.224560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.241898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.246662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.279222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:27.282852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:27.286952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:27.290300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 388/756] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:27.292146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.355615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9930165-b3bc-4222-af5b-2b220c1ca5e9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.394856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.395680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.395966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.396248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.402576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:27.405433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.406929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0a93ceb9-4485-4fe1-b417-96d09161321d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:27.425888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:27.427736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 369/757] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1167e-a328-420e-95ec-a4d8db5f3896 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.431442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1167e-a328-420e-95ec-a4d8db5f3896 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.433089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1167e-a328-420e-95ec-a4d8db5f3896 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.433089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 370/758] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:27.440404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.440404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.440404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.463100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:27.464856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:27.474449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685910d-5e5e-4fee-8702-8fc0c6e55155 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.513514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.514277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.514567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.514847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.515650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:27.516013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.517558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.538115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 389/759] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:27.539066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.568704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 371/760] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:27 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:27.569693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.645058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:27.669340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:27.672394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cecfe20-ab0d-44eb-ba0b-b2328cdaa548 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.703763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76bfe5b-b686-4daf-ba4c-6bede7f33f7f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.725022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.725961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.726428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.727470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.728813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:27.729288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.731697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.743176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.744176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.744736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.745090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.747921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=bf8a03a9bb9848c0a51808883cb9f929, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.749495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:27.758115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 390/761] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:27.759287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.774401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 372/762] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:27 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:27.779926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:27.940027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa719e47-942a-4e54-9f1a-0bfccc05438e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:27.987167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:27.988761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:27.989052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:27.989330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:27.990011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:27.991453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:28.017232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:28.018300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:28.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:28.024887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 391/763] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:27 2022] GET /identity/v3/services/network => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:28.029326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:28.070294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:28.075304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a65be-8c09-4896-90f9-0f1f9a6e4088 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:28.094079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:28.125672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:28.126403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:28.126847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:28.127106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:28.178617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c381b2f-e390-4ef8-8527-51a86f83aff7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:28.227177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:28.228620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:28.251520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:28.252220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:28.252542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:28.252830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:28.253634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] RBAC: Adding query filter params (name=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:28.253941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:28.255365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:28.261600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 392/764] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:28 2022] GET /identity/v3/services?name=network => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:28.271303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:28.446228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:28.473354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 373/765] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:27 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:28.479343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd792e60-4c37-4571-9b1f-c51fc82abd98 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:28.481679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:28.503828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:28.569698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:28.570385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:28.570723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:28.571004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:28.571735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] RBAC: Adding query filter params (type=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:28.572043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:28.573709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:28.589947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 393/766] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:28 2022] GET /identity/v3/services?type=network => generated 352 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:28.610231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:28.675220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaefb3f-7162-4876-9411-4ff46b4d9cc2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:28.714067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:28.715063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:28.715409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:28.715568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:28.727061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:28.728812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:28.748102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:28.749836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:28.751690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:28.751690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:28.751690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:28.751690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:28.751690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 374/767] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:28.763064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:28.899313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:28.921022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253b972-cc36-4127-bae1-2d600a27551b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.013215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22495016-c3cb-4c17-9f51-a70165feaeb1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.038568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.038568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.038568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.038568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.039796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] RBAC: Adding query filter params (interface=public, service_id=2514db934a584335b01013255fcf9af2, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:29.039796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.039796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.053916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 394/768] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:27:28 2022] GET /identity/v3/endpoints?service_id=2514db934a584335b01013255fcf9af2&interface=public®ion_id=RegionOne => generated 195 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:29.059208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.095287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.095972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.096256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.097674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.098431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:29.098743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.100137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.103346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:29.127294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 375/769] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:29.136085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.256771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3321d8f8-bcd1-442a-8f4e-328847e0f536 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.301440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.302385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.302821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.303235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.304068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.304245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1a9e0-59b7-4566-a8f9-1a00d92e3892 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.305802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb29476-4a10-4c83-8b5d-7333e6895d6f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.312673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 395/770] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/services => generated 776 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:29.314278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf623f-259f-4edb-9d61-00f3aa7a7a27 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.314724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf623f-259f-4edb-9d61-00f3aa7a7a27 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.315245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf623f-259f-4edb-9d61-00f3aa7a7a27 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.317722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 396/771] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:29.346014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.346227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.346488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.362227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:29.373723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.374781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.375425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.376100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.377676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:29.378915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:29.384863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.386775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:29.403638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:29.404866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:29.405966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:29.408321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 376/772] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:29.414826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.553361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455b2ac-9f80-4bd5-a380-da0ff4fef1ee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.596624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.598076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.598717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.599575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.600432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:29.600751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.602222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.615821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 397/773] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:29.617044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 377/774] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:29.623878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.637357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:29.640446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.707842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:29.765213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850954b5-a9b7-4fb4-92c5-a0e2740f2abd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.785901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508a0e16-a4d1-45e4-acd7-e01b514e625b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:29.811086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.811959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.812486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.812967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.814812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=2822bb6d0cb3450498fcdbc85d51070f) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:29.815456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.818736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.832437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 398/775] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/role_assignments?user.id=2822bb6d0cb3450498fcdbc85d51070f&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:29.836200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:29.837719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.838372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.838887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.839924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:29.842406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-72db9598-f55b-4acf-ac94-3b61515a016d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:29.860541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:29.861645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:29.862496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:29.871113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 378/776] 10.222.0.102 () {56 vars in 1134 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:29.873392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:29.892700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76598-850c-4444-985f-d3177c4c78dd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.893362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76598-850c-4444-985f-d3177c4c78dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.894435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e76598-850c-4444-985f-d3177c4c78dd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.897834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 379/777] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:29.903201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247397-0d57-4b59-b945-260040d12234 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:29.903877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247397-0d57-4b59-b945-260040d12234 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:29.904437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32247397-0d57-4b59-b945-260040d12234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:29.923907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-32247397-0d57-4b59-b945-260040d12234 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:29.925874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-32247397-0d57-4b59-b945-260040d12234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:29.975744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:30.016859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d19ad-413d-46ff-adce-69d5d1f1731c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.066987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.067616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.067884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.068416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.068943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:30.069257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:30.070714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:30.089352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 399/778] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:29 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:30.093598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.112360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 380/779] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:29 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:30.138158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247397-0d57-4b59-b945-260040d12234 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.223989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:30.292694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a658d4-8dbc-4884-893e-950dd2fb166b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.327896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32247397-0d57-4b59-b945-260040d12234 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.359917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.360977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.361337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.361793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.363481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:30.363814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:30.366171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:30.376111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:30.388284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 400/780] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:30.399358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.433327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.434183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.434572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.434952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.480571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:30.512597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:30.513731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:30.515482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 381/781] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:30.524952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.675417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d673c-6a9e-472b-941f-8b2ca2ef61ae None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.713343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.714153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.714412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.714690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.715503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] RBAC: Adding query filter params (interface=public, service_id=6963fb15fc914f45a72dcc9eda913c69, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:30.715818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:30.717361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e3c68-287a-4a8c-a905-96f5a0ff5c1f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:30.724532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 401/782] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/endpoints?service_id=6963fb15fc914f45a72dcc9eda913c69&interface=public®ion_id=RegionOne => generated 195 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:30.725911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c381-799c-4ddd-b4f8-cc17411d00f9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.726202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c381-799c-4ddd-b4f8-cc17411d00f9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.726489 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3c381-799c-4ddd-b4f8-cc17411d00f9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.730585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c094d-692d-41e0-8552-b2d6dd5014dc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.732317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:30.734163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 402/783] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:30 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:30.735348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c381-799c-4ddd-b4f8-cc17411d00f9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.770740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.771419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.772018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.772137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.772972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:30.773199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:30.774714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06772f-6a28-4c1c-9d28-f2e48d337954 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:30.785294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 382/784] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:30.786638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.787252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.787252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.806341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:30.807737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:30.815806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:30.862273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3c381-799c-4ddd-b4f8-cc17411d00f9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:30.890601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 383/785] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:30 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:30.891509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:30.902980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:30.904084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:30.904661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:30.905159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:30.906157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:30.907779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:30.914445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 403/786] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/services => generated 776 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:30.968827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.050903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:31.065997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27f422-6b11-46b6-ae57-78b1eb950ea8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.152396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.153619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.154142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.154616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.168889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:31.170738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:31.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:31.192622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:31.193510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:31.193510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:31.193510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:31.193510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:31.195041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c238e-32bd-4d57-95e0-a52c4b283d0c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.196180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 384/787] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:31.202029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.225011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:31.234494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.235319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.235605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.236184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.248902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:31.256724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:31.257718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:31.258546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 404/788] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:31.264795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.350364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462ef8f-db7f-4c23-a1fb-93bc78268c6f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.455354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.456099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.456965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.457249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.457999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:31.458307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:31.459709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:31.475996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 385/789] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:31.483244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.495524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f097e-7ee1-41c8-a92f-9258a22a5b32 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.500033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:31.543524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.544210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.544673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.544960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.545729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:31.546320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:31.547444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:31.557388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 405/790] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:31.564236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.657800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:31.708837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0d707-0dbc-4130-9835-d0a4e7845083 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.709179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50560f0e-4069-499b-90b2-e3b3bc7b98af None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:31.757209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.758034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.758325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.758605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.785285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:31.787003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:31.788593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:31.789982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:31.790488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:31.790990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:31.803795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:31.805660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:31.832396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:31.833388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:31.834307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:31.834307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:31.834307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:31.834307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:31.834307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 406/791] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:31.838179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:31.842948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:31.843887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:31.844887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:31.850691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 386/792] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:31.860750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:31.998828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:32.094465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2ade-36e8-491f-a54a-5d6fd577d5f5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.145702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8324dab-b857-40af-9a21-1e1122290cc1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.148730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:32.191738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.196401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.196401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.196401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.196401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:32.196401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.199254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.236026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 387/793] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:32.246103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:32.261322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.262049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.262323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.262604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.263370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:32.263680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.265164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.305054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 407/794] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:32.314463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:32.453290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20e9ab-55b4-4d6b-9972-dbfe38b2c986 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.504186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:32.526730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.528099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.528646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.529149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.551256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.554019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.587889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e673-7f74-4304-97c0-3620236a123b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:32.599001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:32.599987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:32.600936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:32.600936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:32.600936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:32.600936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:32.601768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 388/795] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:32.626332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:32.661731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.663111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.663627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.664099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.686914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.696331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c96d2830-2197-4478-9efe-896c09797962 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:32.726290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:32.727282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:32.728720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 408/796] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:27:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:32.733722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5279-087c-4a09-a3db-ffb0042b90ec None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.734025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5279-087c-4a09-a3db-ffb0042b90ec None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.734315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f5279-087c-4a09-a3db-ffb0042b90ec None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.735819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 409/797] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:32 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:32.736609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f5279-087c-4a09-a3db-ffb0042b90ec None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:32.766184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:32.853871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f5279-087c-4a09-a3db-ffb0042b90ec None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.867948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fbc2d-67fa-4a23-8d65-edf93f93baa2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:32.891818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.892513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.892803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.893079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.894480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:32.894794 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.896273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd840c-137f-4bea-a35c-820333a71888 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.920469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 410/798] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:27:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:32.920469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.920469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.920469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.922633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:32.923345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.923605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.923883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.925004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:32.925507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:32.926717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2924c7-e68b-4cf5-b46c-fc3d7e685207 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:32.938567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:32.939774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:32.939951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 389/799] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:32.941320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d8b6-bacc-4f7c-baf2-3f63cc86155e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:32.941615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d8b6-bacc-4f7c-baf2-3f63cc86155e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:32.941890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d8b6-bacc-4f7c-baf2-3f63cc86155e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:32.948905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 390/800] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:32.948905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496d8b6-bacc-4f7c-baf2-3f63cc86155e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:32.993405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.036883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 411/801] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:32 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:33.038188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.054026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.092051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496d8b6-bacc-4f7c-baf2-3f63cc86155e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.139125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.140251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.140769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.141223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.158449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00eb0f-d167-4542-bc62-db9f5d33234c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.197052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.197870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.198160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.198438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.207379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.211540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.227278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.228984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bd1207d7-5479-44c1-a9d0-876232cf0756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:33.229153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:33.230816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:33.232669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:33.235047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 412/802] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:33.236416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.236696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.236989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.256606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:33.257796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:33.271034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.335776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.341487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 413/803] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:33 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:33.342702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.363991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 391/804] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:32 2022] GET /identity/v3/auth/tokens => generated 1003 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:33.364906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.499223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f30be12-45dc-43c2-be2e-5b38005f599d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.522227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d755f9-e532-4d19-8bdf-c38530406acd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.538305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.539107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.539389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.539666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] PATH_INFO: `/v3/services/network` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.540327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.542087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:33.556443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:33.566905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:33.568937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 414/805] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:33.571413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.593974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.594649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.594935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.595217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.596024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:33.596344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.597973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.600025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.614167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 392/806] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:33.614823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.661854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.707043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde53f79-925a-4d13-9fae-f5d0fb8ee7ec None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.744874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fae22-5b05-471b-82f6-2fb04c85bf97 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.762127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.763505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.764017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.764505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.781270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.781982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.782266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.782363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:33.782552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.793641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.795113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:33.798592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:33.801436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 415/807] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:33.804100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:33.822055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:33.823189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:33.824120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:33.824120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:33.824120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:33.824120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:33.824120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 393/808] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:33.824463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.878121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.930140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafb374-2102-4088-91d6-0a558b6b4f29 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.942151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10cf1-bf49-466a-a2c8-d1295774c46c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:33.957103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:33.969979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.970697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.971051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.971371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.972674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] RBAC: Adding query filter params (name=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:33.972989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:33.974378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030eed4-8c0d-4104-80e6-8f4af580bb12 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:33.979369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 416/809] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/services?name=network => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:33.980715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453af7-c896-4d5a-be78-a7e9fa064b0f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.981003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453af7-c896-4d5a-be78-a7e9fa064b0f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.981280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2453af7-c896-4d5a-be78-a7e9fa064b0f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.982568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 417/810] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:33.983275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2453af7-c896-4d5a-be78-a7e9fa064b0f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:33.990429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:33.992048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:33.992619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:33.993169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/34368002fec64283a184b548b246f345/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:33.997444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=34368002fec64283a184b548b246f345, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.000257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.020771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 394/811] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:33 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/34368002fec64283a184b548b246f345/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:34.022449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.144207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2453af7-c896-4d5a-be78-a7e9fa064b0f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.178505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a84ef-c010-4c78-ba55-32bfd8db1732 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.189622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:34.225193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.225888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.226361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.226827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.227896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:34.228193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.230585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.250562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 418/812] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:33 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:34.251771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.252645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.253048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.253456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.253904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.254381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:34.254759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.256305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5e8c-f01f-4b1e-9a5c-148dc120a6a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.272149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 395/813] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:34.274511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.275018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.275521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.301146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:34.303114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:34.340472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:34.407781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0754348-e7c5-4752-a052-346600919a33 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.420465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 396/814] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:34 2022] POST /identity/v3/auth/tokens => generated 1003 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:34.422121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.455002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.456441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.456842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.457129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.457864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] RBAC: Adding query filter params (type=network) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:34.458178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.459589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.465713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 419/815] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/services?type=network => generated 352 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:34.466570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.575541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:34.586990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b0e34-6ffa-47af-a8f9-b3f24c5ec3f1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.642730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95367-b32c-4e3b-a093-473d4b19f246 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.650736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.652098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.652672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.653180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.670074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:34.672181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.674367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:34.694585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:34.695728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:34.696695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:34.696695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:34.696695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:34.696695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:34.700204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 397/816] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:34.701185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.711384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.712969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.713485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.713986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.727223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.730076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:34.754850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:34.756884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:34.758463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:34.761319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 420/817] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:34.761997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.857010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22123b8-ca83-4785-8d9a-f20cb3587412 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.905577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.906676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.907059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.907440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.908236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.909884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:34.918335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4220-c085-4ad8-ac0a-0cc891c01c61 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:34.923921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:34.925428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 16:27:34.926472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:34.933649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 398/818] 10.222.0.102 () {56 vars in 1134 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:34.933649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:34.951624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:34.980267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:34.980989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:34.981276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:34.981599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:34.982384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:34.983834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.012340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 421/819] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:27:34 2022] POST /identity/v3/endpoints => generated 329 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:35.013326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.064002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:35.124494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be931ac4-7737-4bfb-9a80-b2cdeffa00de None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.194850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.196768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.197524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.198215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.198397 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d68e5a-9c51-48ff-90ef-051d01e83299 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.200411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.202729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.205650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.243922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 399/820] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.243922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.271119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.273131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.273896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.274528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.277368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.278190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.281092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.318844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 422/821] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.320686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.389177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:35.457676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485bfa3-98a3-4d98-a760-beba6504763c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.478048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:35.489735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e8289-74d8-42d8-a0bf-ba2bb0859f85 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.507480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.508494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.508792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.509105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.510221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.510539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.511963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.519116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 400/822] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.520223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.541022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.542742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.543262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.543884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.558630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.561449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:35.591514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:35.592604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:35.593559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:35.594089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 423/823] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:35.595249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.642003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c22679-3963-4fc0-b99d-b7f8ffe12d8a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.675530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:35.680931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.682136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.682822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.683344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.684643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.684995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.686532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.700416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 401/824] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.700416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.827936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6a57f-4c70-4779-8d1d-3dd18383ede2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.864066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99340c-594f-4a1e-a933-fad7e0701c4f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:35.868016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.869046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.869526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.869995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.870914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.871421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.873107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.879677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 424/825] 10.222.0.102 () {56 vars in 1129 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.890083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:35.907386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:35.910955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:35.910955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:35.910955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:35.910955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:35.910955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:35.911972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:35.920997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:35.936612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 402/826] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:35.947053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:36.033652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:36.097389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3be06-70a9-4591-ab37-7cadce02e47b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:36.099208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e565d-ac03-48b1-bc54-951982bc8585 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:36.147582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:36.148956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:36.149299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:36.149586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:36.161736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:36.162413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:36.162732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:36.163012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:36.163464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:36.163767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:36.164975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:36.166154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:36.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:36.190156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:36.191868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:36.191868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:36.191868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:36.191868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:36.194481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 403/827] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:36.195613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:36.216557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 425/828] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:27:35 2022] POST /identity/v3/endpoints => generated 348 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:36.319333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105fa4e-831d-40d3-adad-1352bbbfdd48 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:36.328519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:36.369322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44298-9d16-4772-b749-957000774d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:36.369914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44298-9d16-4772-b749-957000774d19 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:36.370199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44298-9d16-4772-b749-957000774d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:36.370509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d44298-9d16-4772-b749-957000774d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:36.371297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d44298-9d16-4772-b749-957000774d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:36.371617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d44298-9d16-4772-b749-957000774d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:36.373146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d44298-9d16-4772-b749-957000774d19 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:36.387636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 404/829] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:36.393371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:36.532995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:36.602025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd84873-b81c-450d-b1d1-84b413000d42 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:36.670746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:36.672019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:36.672570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:36.673081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:36.692326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:36.695271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:36.724553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:36.726441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:36.728192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 426/830] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:36.732721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44298-9d16-4772-b749-957000774d19 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:36.857754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d44298-9d16-4772-b749-957000774d19 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:36.897612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:36.898290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:36.898582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:36.898869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:36.899693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:36.900144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:36.901714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62445a-185c-4989-9e0c-2203e4c20ae8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:36.916845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 405/831] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:36.922459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.048032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba70b4-2014-4a0b-92f9-96b1c297b2f7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.048417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba70b4-2014-4a0b-92f9-96b1c297b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.048646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba70b4-2014-4a0b-92f9-96b1c297b2f7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.051283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 406/832] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:37.057295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.057611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.057888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.082931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:37.084614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:37.107436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2460dc3-ec39-4c01-8268-ee452fbb0ac7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.108565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:37.154236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:37.164535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.165514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.165858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.166147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/2822bb6d0cb3450498fcdbc85d51070f/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.188966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 407/833] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:37 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:37.191353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=2822bb6d0cb3450498fcdbc85d51070f, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:37.192963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:37.210401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.211933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 427/834] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:36 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/2822bb6d0cb3450498fcdbc85d51070f/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:37.344275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9305f6e-d8ab-43e2-8291-4844ddc3ee10 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.387766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.388704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.389007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.389276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.403219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:37.412082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:37.413976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:27:37.415609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:37.418108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 408/835] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:37.419935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.538033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f9f96-29e4-4bc3-bd3a-cb9e692ef9f2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.577822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.578768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.579205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.579671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.581150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:37.581638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:37.583174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:37.597760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 428/836] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:37.600421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.619904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:37.755318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625b345-8600-491f-be11-c0e7c5a6d333 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:37.808669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:37.809397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:37.809689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:37.809979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:37.822792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:37.824340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:37.843278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:37.844275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:37.845455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:37.845455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:37.845455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:37.845455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:37.845455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 409/837] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:37.852653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:37.901146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:37.964802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b5974-6309-4d0d-868f-0bdb75443449 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:38.003797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:38.004520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.004813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.005098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.005843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:38.006155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:38.007564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:38.026287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 429/838] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:38.027718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:38.133017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:38.204302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485ddb-01e8-451a-91e0-b790c40dccf4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:38.266423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:38.267852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.268925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.269427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.284722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:38.287543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:38.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:38.314050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 16:27:38.315561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:38.320561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 410/839] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:27:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:38.325099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:38.452197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274553b1-c667-49a0-9c77-abc2af7288eb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:38.453989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:38.491195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:38.492358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.492903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.493396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.494524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:38.495010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:38.496761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc0e99-54ad-49b3-8a19-47c1977346ab None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:38.526761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 430/840] 10.222.0.102 () {56 vars in 1140 bytes} [Thu May 26 16:27:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:38.528418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:38.545372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6684-9a84-4930-a01b-34b202de03fa None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.546007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6684-9a84-4930-a01b-34b202de03fa None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.546007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f6684-9a84-4930-a01b-34b202de03fa None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.547298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 431/841] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:38.553288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.553587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.553856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.573624 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:38.574826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:38.661071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 432/842] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:38 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:38.675743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6386ab7-326e-4dc9-96ad-24a1c85ed105 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:38.694311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:38.703611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:38.725750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:38.727417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.728332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.729279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.799103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:38.810296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ed98a-a29e-4972-a686-6027b766b9cf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:38.850062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:38.850892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:38.851179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:38.851523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:38.852361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:38.853635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:38.857980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:38.860384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:38.866641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:38.867987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:38.868964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 433/843] 10.222.0.102 () {56 vars in 1137 bytes} [Thu May 26 16:27:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:38.876883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.020129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 411/844] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:38 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:39.025958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.045480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de65f7cb-226f-4af1-9463-474c89d2b58f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:39.062849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:39.099512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:39.101456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.102856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.103662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.105321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:39.106082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:39.108707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:39.120598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 434/845] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:38 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:39.123339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.156335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:39.221199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b912-99ac-437b-a3a5-c300381e3328 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:39.253911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62153fa-7977-4639-aab1-62cd103d69dd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:39.290869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:39.292259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.293042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.293832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.295054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:39.295804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.296190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.296602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.297486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:39.297892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:39.299716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:39.311168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 435/846] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:39 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:39.317543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:39.319078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2878e770-b55b-44d6-a64f-80ea42b526b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:39.340758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:39.342527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:39.344263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:39.344263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:39.344263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:39.344263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:39.344263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 412/847] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:39.351455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.504558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:39.541922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660fae2-cb5e-46d1-809c-7dfbff6f2637 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:39.575813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758d95-2055-4984-8974-f6d470ff34f5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.576205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758d95-2055-4984-8974-f6d470ff34f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.576452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d758d95-2055-4984-8974-f6d470ff34f5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.579281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 413/848] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:39.587716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05e9-e31f-46f0-b751-558aaa3e62a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.588773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05e9-e31f-46f0-b751-558aaa3e62a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.589517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a05e9-e31f-46f0-b751-558aaa3e62a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.595261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:39.596052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.597027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.597204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.597868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:39.598185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:39.600793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:39.619987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 436/849] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:39.628306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-364a05e9-e31f-46f0-b751-558aaa3e62a8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:39.630451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-364a05e9-e31f-46f0-b751-558aaa3e62a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:39.633909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.765857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93ccea-dc2e-4128-ae3e-740172eacb06 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:39.806956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:39.807690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.807974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.808248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.816732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:39.818463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:39.835429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:39.836406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:39.837316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:39.842732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 437/850] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:39.844428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:39.847907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:39.897490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 414/851] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:39 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:39.899800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae45f0-028f-4103-9242-1c876dc43361 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.900288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae45f0-028f-4103-9242-1c876dc43361 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.901410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae45f0-028f-4103-9242-1c876dc43361 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.904870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 415/852] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:39 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:39.912801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:39.916398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:39.916398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:39.933477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:39.942832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:39.944501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:40.063942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cb7a5-e2a0-4027-b32f-81bb26fa8b69 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.088975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 416/853] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:39 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:40.090223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.128686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.129364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.129655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.129938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.130882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.131206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.132818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.154144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 438/854] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:40.155492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.247651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.307499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab3afb-0b8f-4620-8f82-862bbe3b2137 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.310540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400e2e2-e9c7-40be-8f92-87a4113414b2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.355442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.356482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.356979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.357435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.373371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:40.381070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.382501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.383027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.383527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:40.383799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:40.385550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:27:40.396098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:40.398436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.398606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 439/855] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:40.398752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.398900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.400162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:40.415765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:40.417942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:40.419114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:40.428497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 417/856] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:40.430006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.589901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899d6f-593b-4624-a6d9-ea6a40a70521 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.595269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39911433-8182-499f-8b95-53e45cc0d56d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.631654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.653163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.654043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.654222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.654666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.655105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.655261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.655556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.656002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.656668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=34368002fec64283a184b548b246f345) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.657183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.657360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.657840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.660133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.665253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.684613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 440/857] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/role_assignments?user.id=34368002fec64283a184b548b246f345&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:40.684613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.685011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 418/858] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:40.701958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:40.851293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf13da-0ba6-40b7-a36e-7e0d0a262d41 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.865091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:40.933584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:40.934380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:40.934778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:40.935068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:40.935814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:40.936340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:40.939276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:40.949145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 441/859] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:40.957810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9e345-3afa-4d17-9876-d3186f6b3570 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:40.958450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:41.040005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:41.041425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:41.041954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:41.042440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:41.055177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:41.066511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:41.069456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:41.114137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:41.116191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:41.117815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:41.117815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:41.117815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:41.117815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:41.117815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 419/860] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:41.126887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:41.149980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c169b-bff1-4f09-9c79-ba8305158946 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:41.191241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:41.192323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:41.192839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:41.193423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:41.194378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:41.194893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:41.196569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:41.202379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 442/861] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:40 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:41.363319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a4f39-5c6b-438f-8f72-a1dee751ce12 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:41.404618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:41.440830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:41.442012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:41.442482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:41.442996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:41.444558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:41.445027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:41.447748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:41.473419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 420/862] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:41.478935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:41.596969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86914347-50c2-40f8-ab7f-939d335295db None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:41.613836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:41.637631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:41.639273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:41.639785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:41.640288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:41.650146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:41.652011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:41.669370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:41.670342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:41.671282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:41.674896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 443/863] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:41.681752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:41.882596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ca37-06b3-4c80-820d-860eb07a1385 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:41.955876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:41.957009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:41.957524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:41.958027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:41.959671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:41.960247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:41.963081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9087f6-bb0e-4d19-a494-43e874de9e0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:41.999158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 421/864] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:42.004829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:42.123195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14caef98-546b-4ee0-ae63-a0452371a2e9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:42.162743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:42.163790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.164284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.164798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.202591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a7db-60df-439e-ad09-b21872a46f98 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.203123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a7db-60df-439e-ad09-b21872a46f98 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.203576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084a7db-60df-439e-ad09-b21872a46f98 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.207777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 422/865] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:42 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:42.224054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:42.226888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.227383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.227925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.248770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:42.250734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:42.260098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:42.262358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:42.326890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:42.372575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 444/866] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:42 2022] GET /identity/v3/auth/tokens => generated 1153 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:42.375342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:42.420961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 423/867] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:42 2022] POST /identity/v3/auth/tokens => generated 1153 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:42.458702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:42.463718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:42.493788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95d54f-a210-45ef-b48a-a07e6df6ac79 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:42.535820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:42.536706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.537006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.537267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.550467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:42.552016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:42.572965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:42.574750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:42.576601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:42.576601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:42.576601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:42.576601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:42.576601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 445/868] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:42.581434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:42.681698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4def873c-1e4b-4200-8b1a-f951f771cead None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:42.693724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e504d5-a98d-4a6c-a56c-4acb091dc0f1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:42.726135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:42.736033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:42.736915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.736915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.737216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.737876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:42.738767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:42.741114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:42.755235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 446/869] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:42.760933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:42.761198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:42.762502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.763194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.763885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.765598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:42.768929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:42.805174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 424/870] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:42 2022] POST /identity/v3/services => generated 270 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:42.929821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806c8e-9ad5-46f9-9459-4de8ea227e9f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:42.982124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:42.982856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:42.983145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:42.983427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:42.992185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:42.993779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:43.011198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:43.012836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:43.015719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 447/871] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:43.020706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.069212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:43.225271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de7943-b34b-4b80-a216-b2232eb23a49 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:43.289502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:43.291286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.292132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.293025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.294675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:43.295298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:43.298474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05361e-7e18-4d25-b0d9-0b638f8d6998 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:43.330884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 425/872] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:43.337036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.390075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:43.460624 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be995c17-55c4-4964-b12a-fb4b95c4daf1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:43.501441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:43.502695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.502988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.503269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.504162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=2822bb6d0cb3450498fcdbc85d51070f) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:43.504596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:43.506073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:43.509657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db247-788f-440d-a03a-282f0404dc30 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.510469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db247-788f-440d-a03a-282f0404dc30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.511156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5db247-788f-440d-a03a-282f0404dc30 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.514290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 426/873] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:43 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:43.518138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 448/874] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/role_assignments?user.id=2822bb6d0cb3450498fcdbc85d51070f&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:43.523265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.523639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.523880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.578423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:43.581346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:43.733526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 427/875] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:43 2022] POST /identity/v3/auth/tokens => generated 1263 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:43.773247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.908026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe83147-1796-4e03-b443-754d0cf7d4bb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:43.917707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:43.950819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:43.951644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:43.951979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:43.952274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:43.952989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:43.954384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:43.967995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:43.969064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:43.969875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 449/876] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:43.977534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:43.994288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.096404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63786e7-078e-4e51-ba75-00d0c9b93459 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.138637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.139724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.140211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.140717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.141650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:44.142158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.143833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d47df-cb24-46f0-919a-c33c07d46ca9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.150166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 428/877] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:43 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:44.156782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:44.288969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253204f1-3c5f-4a30-a6e7-b5672d78e752 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:44.331799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:44.332527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.332818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.333100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.333899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:44.334213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:44.335682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89894b7a-9d17-48b0-8114-4819b554f850 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:44.341688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 450/878] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:44 2022] GET /identity/v3/services?type=object-store => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:44.765386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c87b-1619-4b4b-8b33-e82212439456 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.766957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c87b-1619-4b4b-8b33-e82212439456 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.768263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2c87b-1619-4b4b-8b33-e82212439456 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.771805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 429/879] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:44 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:44.781365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045255-0a74-4aed-836e-50093e196287 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:44.782916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045255-0a74-4aed-836e-50093e196287 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:44.784262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16045255-0a74-4aed-836e-50093e196287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:44.813964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-16045255-0a74-4aed-836e-50093e196287 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:44.817215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-16045255-0a74-4aed-836e-50093e196287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:44.855668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:44.918746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 451/880] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:44 2022] POST /identity/v3/auth/tokens => generated 1263 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:44.963070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2c87b-1619-4b4b-8b33-e82212439456 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.113804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.164966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2c87b-1619-4b4b-8b33-e82212439456 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.238637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.240257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.241151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.241970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.243656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.246552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6755c-b01a-4e7c-859a-066acc27b3e4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.280599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 430/881] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:44 2022] POST /identity/v3/services => generated 252 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:45.340286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc4fd-1f74-4cb5-9fb8-d5189a15eb4b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.341276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc4fd-1f74-4cb5-9fb8-d5189a15eb4b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.342070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cc4fd-1f74-4cb5-9fb8-d5189a15eb4b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.346396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 452/882] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:45 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:45.356936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.357972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.358803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.393278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:45.396103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:45.552558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 431/883] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:45 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:45.575995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc4fd-1f74-4cb5-9fb8-d5189a15eb4b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.699263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cc4fd-1f74-4cb5-9fb8-d5189a15eb4b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:45.739061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:45.739885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:45.740165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:45.740482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:45.741162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:45.742643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c8fc49c2-fae3-4405-9ad5-0af11bf516e9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:45.756085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:45.758517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:45.760934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 453/884] 10.222.0.102 () {56 vars in 1137 bytes} [Thu May 26 16:27:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:45.769967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:45.896343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:45.972902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f536b46-c188-4902-ac31-3040c200a972 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.025770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294471-66da-4911-8a64-e4c04a2f0171 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.026583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294471-66da-4911-8a64-e4c04a2f0171 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.026583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b294471-66da-4911-8a64-e4c04a2f0171 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.028042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 454/885] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:46.033351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.033685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.033917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.039817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.041501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.042023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.042510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.043872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:46.044448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.047193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.054393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:46.056047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:46.056828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 432/886] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:45 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:46.064766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.090136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:46.147217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 455/887] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:46 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:46.171054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.291618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206d466-60e4-4fb7-880d-6ccb1c39bf1b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.298180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db967e9-b9fa-41f5-9319-ee6b5e8fb261 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.348882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.350090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.350597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.351090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.363878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:46.364522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:46.373637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:46.374678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:46.375550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:46.378616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 456/888] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:46.381000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.382006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.382506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.383041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.384220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:46.384348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.384977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.386595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.400519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 433/889] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:46.402189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.410889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:46.507913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7fec4-b7e2-4195-8a60-99029812d1d8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.551684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.552246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.552596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.552860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.553595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:46.553900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.555293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.566487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4f5286-9a2e-4ab9-80c3-6c4b989a2e0c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.570162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 457/890] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:46.571742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.622250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.623315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.624338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.624877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.626358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] RBAC: Adding query filter params (interface=public, service_id=17eac46887e449b9a34a643b4569efd6, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:46.627741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.629434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.645255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 434/891] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/endpoints?service_id=17eac46887e449b9a34a643b4569efd6&interface=public®ion_id=RegionOne => generated 195 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:46.648843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.685898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:46.718849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60da526-df06-4075-9bbb-91bd7b3582b4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.768033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.768878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.769403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.769688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.780740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:46.795306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.799556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.820106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c62fc-dd72-46c3-bc1d-0054b07e3097 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-786be102-cf8e-41e9-8b8b-ce327d6f73f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:46.838482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:46.839460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:46.840357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:46.840357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:46.840357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:46.840357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:46.841134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 458/892] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:46.843681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea0d-4dbb-4f2e-9397-b203102f3d08 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.844211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea0d-4dbb-4f2e-9397-b203102f3d08 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.844862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38dea0d-4dbb-4f2e-9397-b203102f3d08 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.847612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 459/893] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:46 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:46.849221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dea0d-4dbb-4f2e-9397-b203102f3d08 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:46.889629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:46.890310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.890602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.890881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.891573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:46.893592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c0978-56d8-4f14-84f5-d760ac7624f3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:46.902961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 435/894] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/services => generated 1274 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:27:46.904401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:46.904835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:46.905199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:46.929517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:46.930939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:47.013221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38dea0d-4dbb-4f2e-9397-b203102f3d08 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.028934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 436/895] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:46 2022] POST /identity/v3/auth/tokens => generated 1364 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:47.050882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.056237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.058071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.059337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.060853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.062198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.063301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:47.065123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.067271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.085795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 460/896] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:47.092751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.139403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.214661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d881b-e442-4bb8-84af-05449edf4a36 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.240999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763afecf-b2b0-4dda-8475-70277ce39d27 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.273963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.275166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.275849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.276292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.292112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.296867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.301703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.302596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.303194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.303760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.305072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.307966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:47.325117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:47.326692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:47.328553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 461/897] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:47.348393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.348755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 437/898] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:47 2022] POST /identity/v3/services => generated 242 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:47.434535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.492576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423b5cb-21f3-4ac7-a860-47144908ba52 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.541659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.542364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.542647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.542923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.543801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:47.544114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.545652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7294df-6f15-414b-8ca8-6361ad8d2e40 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.567851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 462/899] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:47.573797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:47.734649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff78be-eb3a-4bc7-a123-1c992dd97ddc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:47.747203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:47.784408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:47.785427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.785801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.785956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.888856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da48fa-84c1-4b9d-96f9-23a79a369f22 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.889169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da48fa-84c1-4b9d-96f9-23a79a369f22 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.889560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da48fa-84c1-4b9d-96f9-23a79a369f22 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.892089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 463/900] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:47 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:47.897844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:47.898191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:47.898490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:47.899865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:47.901850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:47.917230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:47.918669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:48.012336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 464/901] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:47 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:48.038745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.050278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 438/902] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:47 2022] GET /identity/v3/auth/tokens => generated 1466 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:48.056069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.068131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.086676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.167781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a59238-45f5-453e-9fc2-0fa502d4b9cf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.175235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821c9e1-6211-49b8-859f-f5bb564ab6c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.214445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.215560 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.216112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.216677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.217527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.217662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.218408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.218701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.218986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.219745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:48.232953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:48.234284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:48.235323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:48.236283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.237233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.238369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 465/903] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:48.244514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:48.263600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:48.264564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:48.265474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:48.265474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:48.265474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:48.265474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:48.268816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 439/904] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:48.271710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.344036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.365186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.370783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185f150-8c09-45c2-a0a3-f28be33b7a8d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.399617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d422831-1c2c-4539-ad36-d6d66965a4c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.414496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.415544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.416011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.416497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.417421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.417913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.419664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.431446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 466/905] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:48.432734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.445263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.445833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.446126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.446488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.447288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.447660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.449284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.464667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 440/906] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:48.470792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.566017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599a188-536a-4486-9e99-b91ea6dfbd12 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.596264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26159bb8-22e6-45e1-8a81-724f1049d514 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.606309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.607397 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.607901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.608427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.609373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.609896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.612122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.620123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.623335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 467/907] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:48.624441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.640193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.641315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.641786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.642264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.650510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.652359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.657765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:48.669027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:48.670204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:48.671210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:48.674162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 441/908] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:48.679579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.750020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dff68-8e2b-4b3e-9a14-1d679fb992bd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.787988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.788748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.789038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.789320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.790238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] RBAC: Adding query filter params (interface=public, service_id=4187dd3efb694cbb8b14bbb5255732a6, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.790523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.791945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.798005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da2648-2a5c-441f-bc0c-ee9d0c3b31ee None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.799355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 468/909] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/endpoints?service_id=4187dd3efb694cbb8b14bbb5255732a6&interface=public®ion_id=RegionOne => generated 195 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:48.804643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.840547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b426-6113-4839-8025-1348a7a916de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.841474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b426-6113-4839-8025-1348a7a916de None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.842016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b426-6113-4839-8025-1348a7a916de None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.842463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977b426-6113-4839-8025-1348a7a916de None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.843594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b426-6113-4839-8025-1348a7a916de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:48.844105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b426-6113-4839-8025-1348a7a916de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.846356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977b426-6113-4839-8025-1348a7a916de None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.866694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 442/910] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:48.867975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b426-6113-4839-8025-1348a7a916de None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:48.912940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.920252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:48.926324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d306f87-81cf-44fe-9d41-02f894844fad None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:48.967548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:48.968245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:48.968607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:48.968899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:48.969610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:48.971568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b652f-9a8d-44f2-87b7-71d3962b750f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:48.979054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 469/911] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/services => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:27:49.027727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977b426-6113-4839-8025-1348a7a916de None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:49.087655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:49.088809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.089273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.089728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.090827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] RBAC: Adding query filter params (role.id=d2d369cb68e24222bd415a5d737502a2, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=2822bb6d0cb3450498fcdbc85d51070f) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:49.091317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:49.093111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed37547-770d-489f-9456-289cfd596d1d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:49.101496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 443/912] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:27:48 2022] GET /identity/v3/role_assignments?user.id=2822bb6d0cb3450498fcdbc85d51070f&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=d2d369cb68e24222bd415a5d737502a2 => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:49.628621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41501f8-6967-4b16-b8d5-15310e000c22 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.629197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41501f8-6967-4b16-b8d5-15310e000c22 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.629197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41501f8-6967-4b16-b8d5-15310e000c22 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.630946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 470/913] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:49.636756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b4e2-b126-4555-b0f0-dd483dd3b363 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.637054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b4e2-b126-4555-b0f0-dd483dd3b363 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.637333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b4e2-b126-4555-b0f0-dd483dd3b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.656124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-77e0b4e2-b126-4555-b0f0-dd483dd3b363 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:49.657387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-77e0b4e2-b126-4555-b0f0-dd483dd3b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:49.739962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 444/914] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:49 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:49.763562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41501f8-6967-4b16-b8d5-15310e000c22 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:49.884182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41501f8-6967-4b16-b8d5-15310e000c22 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:49.892880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a0d00-b11f-47b6-958f-9f9fca9cfc5b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.893397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a0d00-b11f-47b6-958f-9f9fca9cfc5b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.893521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a0d00-b11f-47b6-958f-9f9fca9cfc5b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.895136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 445/915] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:49.900766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.901061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.901350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.918578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:49.920034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:49.922858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:49.923991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:49.924279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:49.924626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:49.925301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:49.926738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:49.940941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:49.941971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:49.942826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 471/916] 10.222.0.102 () {56 vars in 1137 bytes} [Thu May 26 16:27:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:49.948848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:49.958667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:49.974395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:50.016508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 446/917] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:49 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:50.034055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.067724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc2159-adec-43c5-a936-440950e3c0c8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.105306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.105983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.106270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.106574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.107273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:50.107582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.109009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.120167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 472/918] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:49 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:50.121184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.151905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18417b-3e88-4c12-ace0-5d0d3e3b2d23 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.195504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.196391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.196691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.196998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.197743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.199164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:50.212810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:50.213880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:50.214719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 447/919] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:50.222222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.224787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:50.243370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5890e-1bd7-424d-9014-9e44d72c96f3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.255904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:50.282754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.283622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.283738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.284028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.284831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:50.285146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.286782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.297393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 473/920] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:50.299265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.350989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948355-9626-4795-ba23-a77cf97c77ca None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.391491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.392650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.393148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.393668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.394615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:50.395222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.396952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.403339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 448/921] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:50.413621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.446206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388c67e-7ca5-4543-be4e-40aa6e2fd02d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.513369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.514477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.514962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.515455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.516821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.519328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.526824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:50.538641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9591d11-ae0f-461a-8db1-c0c75ee7dba9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.565100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 474/922] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:27:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:50.593472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.594469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.594933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.595421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.596484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:50.597001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.598653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.605687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 449/923] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:50.612357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:50.619126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:50.832887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617a9c-44c5-4dbe-a5e7-5fbaafd7c911 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:50.873969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:50.875016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:50.875487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:50.875947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:50.877046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] RBAC: Adding query filter params (interface=public, service_id=7b87c927ac904fe4818de3306d0e3d60, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:50.877544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:50.879362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d9ac2-083e-48de-847d-dfb053a564cd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:50.885947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 475/924] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/endpoints?service_id=7b87c927ac904fe4818de3306d0e3d60&interface=public®ion_id=RegionOne => generated 195 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:50.893237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.038568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a600c8a-b630-4413-b456-4b3b47b67bab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:51.080614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:51.081794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.082310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.082839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.084234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:51.086914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7907-f3e6-4f1c-966c-67bd1e229e12 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:51.099430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 450/925] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:50 2022] GET /identity/v3/services => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:27:51.486511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74a65e-eb29-488b-a64d-5f30482a9ad6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.486709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74a65e-eb29-488b-a64d-5f30482a9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.486991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74a65e-eb29-488b-a64d-5f30482a9ad6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.488988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 476/926] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:51.489671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ca25-4c71-4044-b71a-74721212686b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.489975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ca25-4c71-4044-b71a-74721212686b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.490320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ca25-4c71-4044-b71a-74721212686b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.491976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 451/927] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:51.494514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.494809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.495093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.497644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.497939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.498223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.519530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:51.520761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:51.520884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:51.522021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:51.536604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:51.600691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:51.611756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 452/929] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:51.616488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 477/929] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:51 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:51.630630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.630937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.741007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6440d87-932b-48d0-8734-be8fb17bdfa9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:51.741266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea96ef-ac7f-41fe-8ee8-920b2a246d5a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:51.779730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:51.780024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:51.780660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.780836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:51.780967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.781103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:51.781242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.781367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:51.781927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:51.783410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:51.794172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:51.796860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:51.800393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 16:27:51.804241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:51.806014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:51.807579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:51.809235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:51.810454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 478/930] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:51.810454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.810709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 453/931] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:27:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:51.811798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:51.821789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:51.933691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:51.981338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01110a7-a663-4f44-954c-8a064fca9f06 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:51.982080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec9be9-cdaa-4430-aebb-d5de0b268dd0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.035642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.036231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.036537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.036823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.037572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:52.037880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.039333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.056984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 479/932] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:51 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:52.060778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:52.061556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.062446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.062833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.063234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.064722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:52.065137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.066661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.080504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 454/933] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:27:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:52.083860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:52.177634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:52.223573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1271de15-240a-485c-944c-489a184dbfe9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.269634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.270626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.271008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.271385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.290617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.295449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7fd64-26f5-405f-94ab-0bdc6e81fc5d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.295799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.330819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:52.337354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:52.339265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:52.341072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:52.341072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:52.341072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:52.341072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:52.344596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 455/934] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:52.349809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:52.350027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.350559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.350836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.351120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.351858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:52.352192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.353769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.360629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 480/935] 10.222.0.102 () {56 vars in 1119 bytes} [Thu May 26 16:27:52 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:52.370348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:52.490973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70a798-862a-4613-9bfb-a0075c3027ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.536343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:52.567908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac4716-8b4e-4a5c-ae70-c1d0a8922d45 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.576163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.578701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.579719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.580222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.582413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:52.583005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.587063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.612530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.613588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.614076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.614577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.615550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.617316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.620664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 456/936] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:52.627294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:52.668470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 481/937] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:27:52 2022] POST /identity/v3/endpoints => generated 348 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:27:52.799796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2962ebd-db7a-429b-8a32-d54f8fed2b69 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:52.888720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:52.890147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:52.890642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:52.891134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:52.908180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:52.911223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:52.945070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:52.946157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:52.947093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:52.948173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 457/938] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:52.954873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:53.046797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:53.153284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1263b7-3dae-4e3a-9180-1a73107f81e5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:53.231842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:53.233556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.234350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.235131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.237250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:53.238124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:53.241162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32840a29-ec4a-45ae-bd34-330ae2142e6b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:53.278495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 482/939] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:53.288359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:53.360867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:53.482395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9fa4-5d60-4a01-bef8-9cf6b8d5721a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.482784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9fa4-5d60-4a01-bef8-9cf6b8d5721a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.483250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c9fa4-5d60-4a01-bef8-9cf6b8d5721a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.492285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9b2a-3079-47b7-ae0f-11ab4ed39869 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:53.492948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 483/940] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:53 2022] GET /identity => generated 271 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:53.495157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.495616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.496078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.521847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:53.523807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:53.574451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:53.576089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.576598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.577350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.602653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:53.604589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:53.639585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:53.640583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:53.641494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:53.641494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:53.641494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:53.641494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:53.642811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 458/941] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:53.649461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:53.662198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 484/942] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:53 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:53.698799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:53.759472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:53.862623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:53.886398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1dbf0-46c9-4161-afe9-eb364b4d0d6c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:53.889494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885de845-6f88-4b72-8ebf-b445f3db18c6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:53.950798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:53.951880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.952415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.952906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.954231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:53.954832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:53.957638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:53.966849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:53.969118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:53.970659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:53.971368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:53.972825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:53.976599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:53.983974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 459/943] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:53.986597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:54.008256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:54.010379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:27:54.012082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.016659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 485/944] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:54.021060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.191594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9047e-6745-4a6d-a335-24fbeb046f37 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.219267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.227777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293e6c1-7c14-445d-82d5-fdd2fd193c9c None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.251839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.253125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.253579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.254074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.263519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.265641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.275959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.276667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.276950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.277237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.277956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:54.278261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.279650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebdbdaf-0b53-4bed-828b-3e94afa51cbb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.286161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 486/945] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:54.287387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560659b-ed77-41f5-825b-70819f00805c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.287682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560659b-ed77-41f5-825b-70819f00805c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.287961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560659b-ed77-41f5-825b-70819f00805c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2cac26a0-3b5b-4da6-9e8f-2dba15062fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:54.288899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:54.291027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:54.293333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:54.293965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 487/946] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:54 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:54.294962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560659b-ed77-41f5-825b-70819f00805c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.296169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 460/947] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:54.299547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.301543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.302082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.326717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:54.327917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:54.331050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.439131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 461/948] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:54 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:54.440568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.464040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560659b-ed77-41f5-825b-70819f00805c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.510036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.511099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.511681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.512070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.513091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:54.514147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.515708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.528735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 488/949] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:54.528735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.602019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.620696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b23f7-73bb-4ff7-b63e-59013fcc176a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.683210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.685078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.686730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.687037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.687863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:54.688186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.689864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.706980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.714354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 462/950] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:54.722132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.768559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b8ae3-b08a-428a-891c-bc860fb98d5f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.832881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.833865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.834264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.834646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.835554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.837377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:54.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:54.854236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:54.855952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 489/951] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:54.860455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:54.862330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e38e10-0f71-41d5-b5bb-6bba9d174d85 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:54.911379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:54.912294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:54.913057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:54.913345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/2822bb6d0cb3450498fcdbc85d51070f/roles/d2d369cb68e24222bd415a5d737502a2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:54.916388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=2822bb6d0cb3450498fcdbc85d51070f, role_id=d2d369cb68e24222bd415a5d737502a2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:54.918624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:54.941151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 463/952] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:27:54 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/2822bb6d0cb3450498fcdbc85d51070f/roles/d2d369cb68e24222bd415a5d737502a2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:27:54.987230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:54.998876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661675-363d-4143-9e90-0063b19d6cc2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.044123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.044803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.045091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.045442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.046204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:55.046524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.048271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.058531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 490/953] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:54 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:55.061599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.138496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.189694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c9c04-84bc-4afe-b5ab-167c7de27ab7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.229593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.230271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.230621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.230902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.231682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:55.231998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.233460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e4e36-674f-4e49-aada-46bef6dcadc0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.241877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 464/954] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:55.246421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.254655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e556db-1967-4bef-8151-3088113e5103 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.254959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e556db-1967-4bef-8151-3088113e5103 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.255269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e556db-1967-4bef-8151-3088113e5103 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.256983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 465/955] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:55.262687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.263090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.263267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.283012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:55.284233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:55.390422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 466/956] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:55 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:55.413656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.463920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81451d42-7183-4e2b-8174-0ff238af9876 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.494019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:55.538961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.540841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.541671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.542430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.543773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.546296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.582550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 491/957] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:27:55 2022] POST /identity/v3/endpoints => generated 351 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:55.603710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687632d8-ee19-403b-bcd8-4863e8ce7cdd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:55.695030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:55.696755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:55.697723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:55.698518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:55.700358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:55.703896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:55.707245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING keystone.server.flask.common [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:27:55.743187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:27:55.743187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:27:55.743187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [parameters: {'id': '38860417a01f4b39bbb451adcc72973e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:27:55.743187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38860417a01f4b39bbb451adcc72973e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38860417a01f4b39bbb451adcc72973e. May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:27:55.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 16:27:55.765124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 26 16:27:55.767992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:27:55.771856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:27:55.775611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:27:55.780036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': '38860417a01f4b39bbb451adcc72973e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.786853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:55.791904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 38860417a01f4b39bbb451adcc72973e. May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:55.797231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 467/958] 10.222.0.102 () {60 vars in 1145 bytes} [Thu May 26 16:27:55 2022] POST /identity/v3/projects => generated 262 bytes in 358 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:55.801005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:55.812726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.013823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95b0d-60cb-4c50-a175-0170cca7d2a8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.057025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.058133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.058567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.058988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.067079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.068854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-85c2eeb1-a2dd-45ad-a234-c3b11346269a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:27:56.085389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:56.086531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:27:56.087606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:56.089860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 492/959] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:56.096360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:56.286355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff682f-6010-4698-9f53-b167c53c05e1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:56.291432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:56.354896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:56.355764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:56.356158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:56.356584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:56.357560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:56.357984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:56.360710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8118b-9151-4a27-a574-d3532610b432 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:56.391039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 468/960] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:27:56 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:57.116487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d8862-2612-4d50-a278-828e82685de0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.117702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d8862-2612-4d50-a278-828e82685de0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.118200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d8862-2612-4d50-a278-828e82685de0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.120234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 493/961] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:57 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:57.127021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3aacd-e7e7-4e22-8f20-cae632b9c8a2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.127661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3aacd-e7e7-4e22-8f20-cae632b9c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.128167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3aacd-e7e7-4e22-8f20-cae632b9c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.147801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d7e3aacd-e7e7-4e22-8f20-cae632b9c8a2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:57.149871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7e3aacd-e7e7-4e22-8f20-cae632b9c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:57.288656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 469/962] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:57 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:57.328682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d8862-2612-4d50-a278-828e82685de0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.399529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513223d-0738-4d1e-ab3d-5f42813a9417 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.400051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513223d-0738-4d1e-ab3d-5f42813a9417 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.400051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513223d-0738-4d1e-ab3d-5f42813a9417 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.402872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 470/963] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:27:57.407655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.407945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.408222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.426945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:57.428170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:57.430899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.452918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d8862-2612-4d50-a278-828e82685de0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.492731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.493707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.494005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.494474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.495495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:57.497507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:57.502704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 471/964] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:57 2022] POST /identity/v3/auth/tokens => generated 1466 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:57.514010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 494/965] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:27:57 2022] POST /identity/v3/services => generated 243 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:27:57.527673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.560089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:57.715735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82faad-4dbd-4ec4-a99c-43319d55e418 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:57.765058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:57.766084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:57.766608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:57.767124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:57.788652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:27:57.805588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:57.806640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:27:57.807488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:57.808227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 472/966] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:57.814378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:57.966009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e612c-d769-4d8d-a262-32bfd889121d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.020801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.030340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.031338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.032398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.033236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.034769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:58.035512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.038574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c6dd-e15c-4773-a344-6342cac4b9e6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.054415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 495/967] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:27:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:58.058398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.170590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.201548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef169c-4bc8-4d6c-8c2e-8a4b5e020d01 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.245335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.246528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.247018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.247521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.254161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff36a-353c-4bd0-a40a-4838105cbc09 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.254726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff36a-353c-4bd0-a40a-4838105cbc09 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.254726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afff36a-353c-4bd0-a40a-4838105cbc09 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.256510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 496/968] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:58.262428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.262750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.262998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.263808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.265570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.281539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:58.283322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:58.288075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:58.289205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:58.290166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:58.290166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:58.290166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:58.290166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:58.297341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 473/969] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:58.299347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.376745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 497/970] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:58 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:27:58.400692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.426479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f624-74b1-4314-854f-13644cc0b919 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.460553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.467517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.468363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.468777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.469184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.470635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:58.471388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.472655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.491392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 474/971] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:58.493045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.525342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bdafa6-c617-4637-9eb2-c2c3929bce2e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.552855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.567618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.568986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.569485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.570130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.571042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.572695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:58.586755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:58.587982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:27:58.588907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:27:58.602313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 498/972] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:27:58.608432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.634668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4fde-a777-4499-b7e7-194646e807fe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.703094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.705244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.705726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.706213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.721441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.724503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.726194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785eaf9-8e1b-46cb-8343-8f32ac852f5b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:27:58.757306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:58.758446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 16:27:58.759430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:58.764606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 475/973] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:58.769277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.771141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.772159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.772697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.773325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.774345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:58.775036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.776861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.783863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 499/974] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:58.790871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:58.851938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.874097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:58.915076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c425c8-49bf-41cd-9979-274670742dfe None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.963981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:58.963981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:58.963981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:58.963981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:58.964436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:58.964436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:58.964436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:58.968935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 500/975] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:58.970729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82182621-e0f3-4986-ac7f-bb480db2d885 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:58.976494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.044123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.045217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.045725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.046220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.048685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:59.049241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.052186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.096571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 476/976] 10.222.0.102 () {56 vars in 1154 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 386 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:27:59.097493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828395e-9a26-44fe-92c1-a6d073f7571e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.098843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.114525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.151333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.152923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.153671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.154050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.155645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] RBAC: Adding query filter params (interface=admin, service_id=7b87c927ac904fe4818de3306d0e3d60, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:27:59.156233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.158914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a17325-e302-4ab1-81bc-59031d4e0377 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.175660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 501/977] 10.222.0.102 () {56 vars in 1254 bytes} [Thu May 26 16:27:58 2022] GET /identity/v3/endpoints?service_id=7b87c927ac904fe4818de3306d0e3d60&interface=admin®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:27:59.178447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcac72-3845-420c-83eb-56728ef32323 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.178966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcac72-3845-420c-83eb-56728ef32323 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.179468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcac72-3845-420c-83eb-56728ef32323 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.182064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 502/978] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:27:59 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:27:59.183373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcac72-3845-420c-83eb-56728ef32323 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.225568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9518574-f2c2-4728-ad74-e960030de8dd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.244042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.277145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.277831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.278116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.278395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.347429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcac72-3845-420c-83eb-56728ef32323 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.386472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.388489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.407214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.408484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.409007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.409512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.410884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.413682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f611b-b762-49d0-8aa8-50d3bf7820ee None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.427739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 503/979] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/services => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:27:59.430025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.430540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.431046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.463564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:27:59.466011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:27:59.546332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.611895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 477/980] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:27:59.614798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.625001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 504/981] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:27:59 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:27:59.638218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:27:59.671759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:27:59.833292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efee151-f952-4a1d-ad7c-4ef34fa5fd93 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.872465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ddb74e-a430-4fc1-abbf-e62051517e85 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:27:59.901879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.903201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.903670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.904138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.924279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.927018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.939112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:27:59.940512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:27:59.941141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:27:59.941715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:27:59.943115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:27:59.946059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:27:59.948684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING keystone.server.flask.common [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:27:59.962922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:27:59.964992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:27:59.967933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:27:59.967933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:27:59.967933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:27:59.967933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:27:59.976425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.sql.core [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:27:59.976425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:27:59.976425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [parameters: {'user_id': 'e5113f72499a489c95a43d8787b569af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:27:59.976425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80289) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 16:27:59.977574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 478/982] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:27:59.977574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 26 16:28:00.003957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:28:00.007389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application yield resource May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application next(self.gen) May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.rollback() May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.force_reraise() May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise self.value May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application session.commit() May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 16:28:00.011139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._prepare_impl() May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.session.flush() May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._flush(objects) May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application compat.raise_( May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application flush_context.execute() May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rec.execute(self) May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 16:28:00.020099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 16:28:00.023613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application result = self._query(query) May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application conn.query(q) May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application result.read() May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 16:28:00.030508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e5113f72499a489c95a43d8787b569af', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.034044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 16:28:00.037241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 505/983] 10.222.0.102 () {60 vars in 1136 bytes} [Thu May 26 16:27:59 2022] POST /identity/v3/users => generated 160 bytes in 336 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:00.040957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.081663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.115878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.190520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b84704-80d2-4c7e-88aa-cae2c5f9c1a6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.191868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e41fba-5d21-4ffa-823e-54df1cb23eae None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.247987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.249135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.249622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.250101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.252096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:00.252537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.252702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.253922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.254440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.254954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612ae9-6794-4198-9094-5f097250e3a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.269312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.271043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.284236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 479/984] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:27:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:00.284236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3c5a-03bf-47a7-9d36-dec486bd49f7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.284236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3c5a-03bf-47a7-9d36-dec486bd49f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.284236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b3c5a-03bf-47a7-9d36-dec486bd49f7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.284236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 480/985] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:00.286162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b3c5a-03bf-47a7-9d36-dec486bd49f7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b488df68-23ad-4675-81b0-1ed7377fdb44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:00.295972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.297065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 16:28:00.298344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:00.299568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 506/986] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:00.301372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.301918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.302399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.327235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:00.329949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:00.445422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 507/987] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:00 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:00.446730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.478155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b3c5a-03bf-47a7-9d36-dec486bd49f7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.503326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.522047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:00.550978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.552238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.552738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.553544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.567239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.569471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:00.598475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.600257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 481/988] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:00.610876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.644270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbacd1-2e22-46b9-8a51-641b808072ff None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.689902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.690643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.690969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.691285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.692318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:00.692817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.694580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.761769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 508/989] 10.222.0.102 () {56 vars in 1106 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:00.763338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.808556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623744a0-ea96-4105-ace7-6624475cdc79 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:00.881269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:00.883304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:00.884074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:00.885008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:00.886230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:00.888898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:00.912865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:00.914728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:00.916243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 482/990] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:00.930919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:00.958911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.008839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363476cb-fb73-475e-942b-8907f7d95e6b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.036180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.087722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.090318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.091133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.091879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.093629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.095232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.098019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.118129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 509/991] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:01.126359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.153264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ac54c-2967-4599-be17-bdd5f2ed356b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.227239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.229347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.230135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.231045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.232639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.233456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.237806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.254422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 483/992] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:28:00 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:01.255672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.327961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc1453-5d15-4f8d-8360-37794c2986ed None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.378611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.380249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.380743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.381197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.382821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] RBAC: Adding query filter params (role.id=d2d369cb68e24222bd415a5d737502a2, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=2822bb6d0cb3450498fcdbc85d51070f) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.383330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.385533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.396019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 510/993] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/role_assignments?user.id=2822bb6d0cb3450498fcdbc85d51070f&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=d2d369cb68e24222bd415a5d737502a2 => generated 610 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:01.436684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aba20-93e5-4913-9369-14c2b9ab80bd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.449991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.482993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.483872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.484282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.484766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.485660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.486113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.487723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.494540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 484/994] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:01.500776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.511994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:01.638687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964392a6-9717-40bd-8512-c09e4610d8b2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.680656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.681344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.681647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.681903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.682727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] RBAC: Adding query filter params (interface=public, service_id=2221089fc48d4327ad2406d698a49487, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:01.683044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.684548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aafcbc-cf96-4ad0-85ad-674c8ef55f04 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.691905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 511/995] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/endpoints?service_id=2221089fc48d4327ad2406d698a49487&interface=public®ion_id=RegionOne => generated 195 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:01.698290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:01.847096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce0a74-e528-4047-b5bc-767741d4fc8f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:01.887786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:01.888502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:01.888858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:01.889096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:01.889777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:01.891791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d3807-79f9-4ef8-9c66-cbb37d5cf5e7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:01.899571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 485/996] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:28:01 2022] GET /identity/v3/services => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:28:02.164234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bfee4-3271-424a-9a39-2fe21f83f151 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.164477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bfee4-3271-424a-9a39-2fe21f83f151 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.164763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bfee4-3271-424a-9a39-2fe21f83f151 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.166364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 512/997] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:02.171885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.172979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.173269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.191243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:02.192483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:02.228849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.272941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 486/998] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:02 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:02.295862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bfee4-3271-424a-9a39-2fe21f83f151 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.386633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:02.430580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bfee4-3271-424a-9a39-2fe21f83f151 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.478266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.479124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.479415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.479690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.480361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.481845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:02.495969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:02.497899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:02.499386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 513/999] 10.222.0.102 () {56 vars in 1131 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:02.514835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.694266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04a022-b9e5-4aa3-afbe-49d70dae81a2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:02.765446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:02.767195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:02.767707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:02.768214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:02.769605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:02.770173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:02.772835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:02.788951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 487/1000] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/services?name=object-store => generated 130 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:02.791119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:02.984190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf385ff6-99e5-4b0a-929e-cba58389ab62 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.048061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.049727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.050620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.051398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.053113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:03.053982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.057048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc883ae3-7e57-4654-9749-28a3a1b249b4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.060421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:03.070236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 514/1001] 10.222.0.102 () {56 vars in 1127 bytes} [Thu May 26 16:28:02 2022] GET /identity/v3/services?type=object-store => generated 358 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:03.080646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:03.122052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:03.236055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfb395-9333-4b95-a529-9192c8bab199 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:03.327713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:03.328895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:03.329374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:03.329803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:03.330752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:03.332697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787633c7-e389-44bb-9813-b280bea90288 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:03.368123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 488/1002] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:28:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:04.225010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e8e8-64f8-4a8b-98be-88c7602cc247 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.225546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e8e8-64f8-4a8b-98be-88c7602cc247 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.225546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0e8e8-64f8-4a8b-98be-88c7602cc247 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.226999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 515/1003] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:04.233416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831d5e-a8d4-4589-9024-2a5221910635 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.234142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831d5e-a8d4-4589-9024-2a5221910635 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.234142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75831d5e-a8d4-4589-9024-2a5221910635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.255391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-75831d5e-a8d4-4589-9024-2a5221910635 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:04.256698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-75831d5e-a8d4-4589-9024-2a5221910635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:04.357692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 489/1004] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:04.383186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e8e8-64f8-4a8b-98be-88c7602cc247 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.457283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e494-f99f-4565-affb-9a0bfb9f0b81 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.457623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e494-f99f-4565-affb-9a0bfb9f0b81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.457853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495e494-f99f-4565-affb-9a0bfb9f0b81 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.459450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 490/1005] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:04.465416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.465710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.466001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.484934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:04.486154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:04.504552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.526004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0e8e8-64f8-4a8b-98be-88c7602cc247 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.579394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 491/1006] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:04 2022] POST /identity/v3/auth/tokens => generated 1710 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:04.587106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.587717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.587996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.588279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] PATH_INFO: `/v3/services/image` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.589111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.590519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:04.603567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:04.604696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:04.605531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.608037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 516/1007] 10.222.0.102 () {56 vars in 1110 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/services/image => generated 86 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:04.611766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.623198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.709485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.750009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714a3a34-bbc1-48bd-8ff3-fa7d7a48a84e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.776600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aacc0-9b83-498c-86be-96200fa6943a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:04.794745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.795778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.796103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.796408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.798403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:04.798970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.801749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.810784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 492/1008] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/services?name=image => generated 123 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:04.817971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:04.837607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:04.838564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:04.838725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:04.838861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:04.839122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:04.839788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:04.841867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:04.867495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:04.869834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 16:28:04.871628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:04.873195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 517/1009] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:04.878427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.005396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aafc3b4-7083-4116-8080-0cc3f6ddf70d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.051269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b591-5991-4654-b693-9b6996c88ee8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.080199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.080199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.080199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.080199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.080933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.081069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.084308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.084630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.095052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 493/1010] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/services?type=image => generated 123 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:05.100259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.101193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.101485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.101771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.102530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.102847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.104328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.112617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 518/1011] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:28:04 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:05.117433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.261020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:05.311335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f080070f-1861-44fb-8953-9e7fbd8394e0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.366143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.367475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.367981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.368522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.369481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:05.369987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.371648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d5735-02c2-41ea-ba72-8dda252abbb6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.379131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 494/1012] 10.222.0.102 () {56 vars in 1117 bytes} [Thu May 26 16:28:05 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:05.387172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:05.546320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76fe46-c2a0-4ebb-ab26-2f7aa205ae98 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:05.616132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:05.617558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.618068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.618569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.620029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:05.622725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b9d4d-42cc-47d8-bad8-e87e8e2dae74 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:05.668418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 519/1013] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/endpoints => generated 336 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:05.853063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8f9c-72c5-4d5b-841b-6127347b8384 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.853308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8f9c-72c5-4d5b-841b-6127347b8384 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.853685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c8f9c-72c5-4d5b-841b-6127347b8384 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.855208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 495/1014] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:05.862053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:05.862550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:05.863051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:05.893629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:05.895828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:05.981547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:06.032068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 520/1015] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:05 2022] POST /identity/v3/auth/tokens => generated 1867 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:06.057599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c8f9c-72c5-4d5b-841b-6127347b8384 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.224783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c8f9c-72c5-4d5b-841b-6127347b8384 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.285070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.286160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.286660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.287164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.289777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.292476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb526c67-e0b0-4c2b-beff-e2bc03dc846c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.300970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 496/1016] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:06 2022] GET /identity/v3/domains/default => generated 200 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:06.302474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:06.464166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40f8f2-afe7-48ea-ab35-aa76d19a41cd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:06.507045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:06.508208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:06.508851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:06.509359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:06.510317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:06.512760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc1809-3fc2-420a-8a87-fa182ea4ef8f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:06.545300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 521/1017] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:28:06 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:07.502194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b856d5-4c46-4a37-a760-a70d5a45cdce None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.503053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b856d5-4c46-4a37-a760-a70d5a45cdce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.503053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b856d5-4c46-4a37-a760-a70d5a45cdce None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.504431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 497/1018] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:07.510099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d8b5-390f-447b-97ec-c831fc946dfc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.510902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d8b5-390f-447b-97ec-c831fc946dfc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.510902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951d8b5-390f-447b-97ec-c831fc946dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.528413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f951d8b5-390f-447b-97ec-c831fc946dfc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:07.529648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f951d8b5-390f-447b-97ec-c831fc946dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:07.552100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:07.628078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 522/1019] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:07 2022] POST /identity/v3/auth/tokens => generated 1867 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:07.670482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b856d5-4c46-4a37-a760-a70d5a45cdce None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:07.690777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:07.875941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b856d5-4c46-4a37-a760-a70d5a45cdce None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:07.920358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:07.920971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:07.921259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:07.921559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:07.922592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:07.924042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bd73f-b2df-4751-ad64-d63adfcd1181 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:07.942829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 498/1020] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:28:07 2022] POST /identity/v3/services => generated 243 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:08.920818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc590-8319-4e20-ad17-910aaa47a1b5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.921390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc590-8319-4e20-ad17-910aaa47a1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.922629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebc590-8319-4e20-ad17-910aaa47a1b5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.925063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 523/1021] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:08 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:08.931655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd1a8-e04b-4fb6-98d4-3bcbd84ada30 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:08.932455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd1a8-e04b-4fb6-98d4-3bcbd84ada30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:08.932455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddd1a8-e04b-4fb6-98d4-3bcbd84ada30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:08.963600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bfddd1a8-e04b-4fb6-98d4-3bcbd84ada30 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:08.964952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bfddd1a8-e04b-4fb6-98d4-3bcbd84ada30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:09.077669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.103240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 499/1022] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:08 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:09.145468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc590-8319-4e20-ad17-910aaa47a1b5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.151004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aefa52-262f-4374-a03d-04c69bc4cb19 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.151456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aefa52-262f-4374-a03d-04c69bc4cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.152076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aefa52-262f-4374-a03d-04c69bc4cb19 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.154011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 500/1023] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:09.160445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.160910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.161337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.182615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:09.183956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:09.280432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 501/1024] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:09 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:09.321272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.340842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebc590-8319-4e20-ad17-910aaa47a1b5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.403862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.404918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.405405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.406478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.428262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:09.444929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:09.445911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:09.446778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:09.447467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 524/1025] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:09.456769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.487961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.495211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343f799-f8a7-460a-b6b2-77f99f8a920a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.528038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.549461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.550712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.551170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.551623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.553532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.556002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.559255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 502/1026] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/domains/default => generated 200 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.568400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.618722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1813-8e37-4a9e-9ead-9f72b4b2ffe5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.661528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.662190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.662477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.662754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.663513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:09.663938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.665390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.674915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 525/1027] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:09.680921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:09.752929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdaa66-cf18-48eb-8045-648a547a8821 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.791840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:09.809908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.811120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.811636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.812176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.813578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.816397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.829286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3cea9-99eb-460c-98a5-d83716f29f1f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:09.857075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 503/1028] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:28:09 2022] POST /identity/v3/users => generated 286 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:09.904596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04241915-782f-4911-ac80-094618277e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:09.906584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241915-782f-4911-ac80-094618277e47 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:09.907339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241915-782f-4911-ac80-094618277e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:09.908010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04241915-782f-4911-ac80-094618277e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:09.928690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04241915-782f-4911-ac80-094618277e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:09.932349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04241915-782f-4911-ac80-094618277e47 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-04241915-782f-4911-ac80-094618277e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:09.969192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:09.971011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:09.972971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:09.972971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:09.972971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:09.972971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:09.972971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 526/1029] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:09.977840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.044364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.112320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4c8b1-25d4-4694-bb90-12c2f636bb0c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.162931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.163935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.164506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.165028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.166509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.167091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.169772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.194722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 504/1030] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:10.203585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04241915-782f-4911-ac80-094618277e47 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.387212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04241915-782f-4911-ac80-094618277e47 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.443653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.459960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.461365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.461802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.462324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.478144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.480836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3a542d9c-e8cb-4a49-8a8c-b51d09b7db00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:10.509292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:10.511229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:10.514096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 527/1031] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:10.518398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.598462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aacb4-ec20-44b0-8c90-249b4de4a1e8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.598793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aacb4-ec20-44b0-8c90-249b4de4a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.599067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2aacb4-ec20-44b0-8c90-249b4de4a1e8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.600710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 528/1032] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:10.606053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.606341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.606629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.625436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:10.626663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:10.701621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 529/1033] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:10 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:10.711724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb52fa-2d4c-48c4-8442-9ce3ecde8a97 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.725668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.728157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.782106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.783405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.783931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.784464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.786135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:10.786688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.789563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.833941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 505/1034] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:10.835366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.855057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dda5c8-6096-4219-b0d4-5b5687c5d0b5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:10.888336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:10.910874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:10.911672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:10.911956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:10.912235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] PATH_INFO: `/v3/services/image` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:10.912932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:10.914329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:10.927171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:10.928338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:10.929679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 530/1035] 10.222.0.102 () {56 vars in 1110 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:10.934693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:10.972937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ceef-3197-464e-a8fe-d5f501795607 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.022217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.023392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.023684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.023965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.057305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc2ed7-4d2f-41b1-8dd4-021f854f914b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.069040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.103500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.104438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.104699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.104990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.106335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] RBAC: Adding query filter params (name=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.106620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.107719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.108299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.109748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.120319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 531/1036] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/services?name=image => generated 123 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:11.121277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.185745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.237807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 506/1037] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:10 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:11.244195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.291697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e05f2-3e07-49c1-8676-cc60150edf4e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.351973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.371703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.372808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.373105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.373388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.375053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.375369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.376898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.389166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 532/1038] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/services?type=image => generated 352 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:11.390846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.410446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251b40f-b57f-48fa-b901-30d9b5538690 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.456664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.457467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.457760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.458035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.471826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.474058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:11.502246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:11.503230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:11.504133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:11.504133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:11.504133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:11.504133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:11.504831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 507/1039] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:11.512005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.513543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4ab3d-017b-4b62-96ae-f3a4688b24b7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.528684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.560569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.561242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.561528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.561862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.562890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] RBAC: Adding query filter params (interface=public, service_id=4cffb6f42fa0447f976af71a996cc0fe, region_id=RegionOne) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.563200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.564777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.571051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 533/1040] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/endpoints?service_id=4cffb6f42fa0447f976af71a996cc0fe&interface=public®ion_id=RegionOne => generated 195 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:11.576839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.648516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c67c22-3b0b-4f36-abe5-2e74249a8811 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.670548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:11.692749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.693428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.693717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.693976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.694723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:11.695032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.696473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.715002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 508/1041] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:11.721055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:11.741058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97850801-6e2e-4390-aeea-a5f156990cd9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.782445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.782670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.782908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.783250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.784437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.786872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.808411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 534/1042] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/services => generated 1966 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:28:11.882025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d06cc0-061f-42b1-8b23-9bab0badac7b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:11.932867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:11.933702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:11.933979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:11.934345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:11.945018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:11.947171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:11.969968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:11.971886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:11.973204 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 509/1043] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:11.977948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.027308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.109098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d8e88-62cf-4e6c-8611-a3c2732f14bf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.148138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.148851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.149137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.149414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.150219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:12.150531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.151996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f4213-5513-47a7-a474-b26db631de95 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.171647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 535/1044] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:12.177441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.242959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.331685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095b76-e7a2-43ea-a9e2-c3ff880dfd1b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.377940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.378850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.379268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.379696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.380820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] RBAC: Adding query filter params (role.id=d2d369cb68e24222bd415a5d737502a2, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:12.381326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:12.383639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967833e6-1ea4-4e6e-b1e2-67bcbec1ca09 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:12.391440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 510/1045] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:12 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=d2d369cb68e24222bd415a5d737502a2 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:12.520214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d87-0747-4d3f-8813-46ac7c51ff03 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.520645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d87-0747-4d3f-8813-46ac7c51ff03 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.521116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0d87-0747-4d3f-8813-46ac7c51ff03 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.524288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 536/1046] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:12 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:12.534521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.535000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.535481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.563485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:12.565493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:12.692941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 511/1047] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:12 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:12.733055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0d87-0747-4d3f-8813-46ac7c51ff03 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:12.922723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:12.929848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0d87-0747-4d3f-8813-46ac7c51ff03 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:12.971135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:12.971941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:12.972222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:12.972540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:12.985228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:12.993877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:12.995720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:13.005316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 537/1048] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:13.008475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:13.045805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:13.149286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018a14-c188-4276-94d4-08e9c44cb5fe None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:13.190256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:13.191270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.191656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.192076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.193035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:13.193472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:13.195017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:13.205350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 512/1049] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:13.215954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:13.436583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b54e0-3e03-4a9c-8743-3f8bbc934b88 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:13.501789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:13.503321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.503831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.504347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] PATH_INFO: `/v3/users/ac3cb389682b485698b2ef43b7048ab8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.531755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] RBAC: Authorizing `identity:get_user(user_id=ac3cb389682b485698b2ef43b7048ab8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:13.534566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdb9b0-6cf6-4f2e-b15c-25aea1b4d20d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:13.538142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 538/1050] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:13 2022] GET /identity/v3/users/ac3cb389682b485698b2ef43b7048ab8 => generated 286 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:13.548249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:13.749657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:13.765225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44945c-0192-4ab7-b64b-09ce98714ca3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:13.834959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:13.836160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:13.836770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:13.837341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:13.963963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:13.966273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b521-bc61-49e7-9805-3165ee121e6d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.144906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.158583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5086ae-df76-419a-b2df-25e9508cab4c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.159215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5086ae-df76-419a-b2df-25e9508cab4c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.159215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5086ae-df76-419a-b2df-25e9508cab4c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.160626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 539/1051] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:14.161296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 513/1052] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:13 2022] GET /identity/v3/auth/tokens => generated 1963 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:14.168185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5086ae-df76-419a-b2df-25e9508cab4c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.170798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a357f-e776-4287-9224-879874ca9af4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.171290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a357f-e776-4287-9224-879874ca9af4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.171955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a357f-e776-4287-9224-879874ca9af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.198367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-006a357f-e776-4287-9224-879874ca9af4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:14.200252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-006a357f-e776-4287-9224-879874ca9af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:14.203039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.326844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 514/1053] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:14 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:14.353944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5086ae-df76-419a-b2df-25e9508cab4c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.355198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a357f-e776-4287-9224-879874ca9af4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.416305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.417818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.418306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.418602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.420636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.424069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.426999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 540/1054] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.433744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.478424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a357f-e776-4287-9224-879874ca9af4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.506890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.520238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.521070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.521354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.521631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.522353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.524207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:14.537419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:14.538659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:14.539573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 515/1055] 10.222.0.102 () {56 vars in 1110 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:14.548713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.568907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:14.589692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf808f6-8236-43cc-8183-e3e1e0e1a589 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.630319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.631003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.631289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.631571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.632440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414, user.id=ac3cb389682b485698b2ef43b7048ab8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:14.632759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.634220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.641775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 541/1056] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/role_assignments?user.id=ac3cb389682b485698b2ef43b7048ab8&scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:14.676549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49307870-e31a-43ff-97d2-e453d6c31c66 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.725109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:14.726164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.726679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.727167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.728148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:14.728699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:14.730385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2d976-f895-445d-af9a-f0a03f3f732c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:14.737268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 516/1057] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/services?name=image => generated 123 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:14.747517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:14.949274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37200ea-7869-4343-b548-99d9698daf7b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.949542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37200ea-7869-4343-b548-99d9698daf7b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.949824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37200ea-7869-4343-b548-99d9698daf7b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.951155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 517/1058] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:14.958560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:14.959062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:14.959563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:14.963677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b61f9-bd1b-4a5a-aae5-a841772dec23 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:14.988307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:14.990359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:15.025229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.026681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.027380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.028051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.029756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] RBAC: Adding query filter params (type=image) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:15.030517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.033539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.044174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 542/1059] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:14 2022] GET /identity/v3/services?type=image => generated 352 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:15.051233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.078278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.081701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.120420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 518/1060] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:14 2022] POST /identity/v3/auth/tokens => generated 1963 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:15.145324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.229146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24919243-1cfe-41ed-9cd8-d2f6a9d0ddbc None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.295733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.297229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.297791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.298302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.299622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.301726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4b617-096b-4b2b-9741-669f6dbe76a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.302249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.335479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 543/1061] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:28:15 2022] POST /identity/v3/endpoints => generated 329 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:15.394028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.395638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.396179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.396781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.421027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:15.438553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:15.440309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:15.450004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 519/1062] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:15.453383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.586048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.649432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba76faf-832c-4ae3-a04e-e804425263b4 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.689011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.689875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.690280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.690682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.691564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:15.692010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.693722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.708986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 544/1063] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:15.710743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:15.757862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:15.833873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a57810e-8661-4bda-8438-7f5b5846678b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:15.873429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:15.874811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:15.875096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:15.875384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:15.887793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:15.889323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:15.910245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:15.911991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:15.918177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:15.918177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:15.918177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:15.918177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:15.918177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 520/1064] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:15.920012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.038238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c140786-5f17-4e06-bb21-d70728a351c1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.072410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.080147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.080896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.081176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.081462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.082178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:16.082479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.083859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.098329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 545/1065] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:16.105182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.273441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:16.291349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbb84-3454-4357-b944-0660bc668c46 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.351797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.353012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.353012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.353301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.363086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.364647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:16.381198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:16.389368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:16.391637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 521/1066] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:16.397061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.602407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c95a0e-a4bc-496e-a107-19f77780f469 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.671269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.672736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.673241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.673740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.675378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:16.675916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.678790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:16.715098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 546/1067] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:16.724837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:16.918180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad6412b-dade-4ee9-824a-55f9d6f95352 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:16.973895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:16.974701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:16.974994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:16.975277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:16.987435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:16.988966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-71c45ec8-cf8d-4786-9394-de9b682a6ca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:17.009736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.011536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.013384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:17.013384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:17.013384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:17.013384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:17.013384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 522/1068] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:17.018412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.096459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5d8c-87d9-4467-8c29-1525949fa118 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.096811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5d8c-87d9-4467-8c29-1525949fa118 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.097027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5d8c-87d9-4467-8c29-1525949fa118 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.098598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 523/1069] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:17.103675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.103944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.104229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.108312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.109434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.123393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:17.125157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:17.175828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b1e4e-220c-4d3b-b88f-e0c1e3e2ce21 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.218360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.219178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.219508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.219793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.220623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:17.220886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.222228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.238135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 547/1070] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:17.244323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.264502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 524/1071] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:17.302840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.396815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69236fc8-63af-43f4-a844-0c97602096d7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.408406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.441670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.442541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.443141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.443440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.452826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.454354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:17.472344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.474728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:17.477234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:17.479058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 548/1072] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:17.480197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.502893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1167df-b48c-4680-872c-9cec26911992 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.557433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.564505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.565713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.566215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.566496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.581731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:17.608715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:17.610612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:17.612720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 525/1073] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:17.618015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.653028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd119-d711-4576-87ce-2f2b51e73e42 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.697617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.698193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.698479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.698759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.699586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:17.699889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.701399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.723516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 549/1074] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:17.726669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.775871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:17.807572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4120a16-ee73-4500-9909-9fd58a20ea5c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.852226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.853517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.853986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.854462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.855887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:17.856427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.859495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.876098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 526/1075] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:17.887036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:17.912181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e19f9-e726-469e-a2a6-d79e93297ea2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:17.973543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:17.974912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:17.975324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:17.975796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/d2d369cb68e24222bd415a5d737502a2` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:17.979439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=bf8a03a9bb9848c0a51808883cb9f929, role_id=d2d369cb68e24222bd415a5d737502a2)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:17.982028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:17.993932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.008993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 550/1076] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:28:17 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/bf8a03a9bb9848c0a51808883cb9f929/roles/d2d369cb68e24222bd415a5d737502a2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:18.059436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f7120-2afb-46fd-a25b-f436cba06775 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.108857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.109828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.110145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.110406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] PATH_INFO: `/v3/users/ac3cb389682b485698b2ef43b7048ab8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.111907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3cb389682b485698b2ef43b7048ab8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.113539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.115751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 527/1077] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:17 2022] GET /identity/v3/users/ac3cb389682b485698b2ef43b7048ab8 => generated 286 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:18.121933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.235623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.250962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ec771-ccd5-4947-8bf0-231a2b18a3e2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.289754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.290625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.290915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.291179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.292457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.293917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6eece-c8c8-4b93-a4de-9fa2a3de39fe None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.300461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 551/1078] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:18.305688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.358149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4280fe-f28d-425e-a50d-b8531852e3dc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.358630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4280fe-f28d-425e-a50d-b8531852e3dc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.359110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4280fe-f28d-425e-a50d-b8531852e3dc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.361690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 552/1079] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:18 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:18.370636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.371348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.371843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.402432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:18.404520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:18.434825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025865c-8b57-42c7-9d62-71cf30ca9821 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.464965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.487627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.489192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.490549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.491081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414/users/ac3cb389682b485698b2ef43b7048ab8/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.495299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] RBAC: Authorizing `identity:create_grant(project_id=f17fcda32bcc4a3cb759d6e7e5738414, user_id=ac3cb389682b485698b2ef43b7048ab8, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.498107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:18.524717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 528/1080] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:28:18 2022] PUT /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414/users/ac3cb389682b485698b2ef43b7048ab8/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:28:18.537034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 553/1081] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:18 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:18.579523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:18.778691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6de213-d354-4a3f-8849-f4afb35cb417 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:18.840840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:18.841507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:18.841797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:18.842074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:18.905993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:18.934073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:18.935572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.057073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 529/1082] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:18 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:19.063169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.163604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.181796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169dea5-6141-472c-a31e-964eb8e5c284 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.225804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.226614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.226906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.227164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.240095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.241603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e1d6e748-3558-454a-bbb6-598b93b2ee94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:19.261163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:19.262826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:19.265207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:19.265207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:19.265207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:19.265207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:19.266041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 554/1083] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:19.268827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:19.382983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:19.408211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb79814-bbd2-4fee-996d-57cc617fa9de None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:19.453195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:19.453870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:19.454157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:19.454435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:19.455187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:19.455500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:19.456959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789dad8-f0ac-4d8a-9367-5f0b4f1f8aca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:19.471199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 530/1084] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:20.504436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452157-eaa2-43bb-8dad-7e3eed997223 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.505277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452157-eaa2-43bb-8dad-7e3eed997223 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.505277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92452157-eaa2-43bb-8dad-7e3eed997223 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.506884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 555/1085] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:20.516941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.517546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.517955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.547584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:20.549689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:20.644586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 531/1086] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:20.686075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452157-eaa2-43bb-8dad-7e3eed997223 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.849340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92452157-eaa2-43bb-8dad-7e3eed997223 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:20.892347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:20.893330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.893687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.894039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.903210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:20.908468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-8af01194-db43-4fb8-aa2d-6ae877eb0818 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:20.917450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:20.919452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:20.921890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 556/1087] 10.222.0.102 () {56 vars in 1125 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:20.928056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:20.958337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b874e7-a6dc-4992-9a9e-7e5d37b341e6 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.958933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b874e7-a6dc-4992-9a9e-7e5d37b341e6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.959392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b874e7-a6dc-4992-9a9e-7e5d37b341e6 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.961820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 557/1088] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:20 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:20.968869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:20.969343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:20.969812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:20.994952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:20.996923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:21.026448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.066490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d05ce4-4707-4a21-8ecc-a0afaf0aff2d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.092606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 558/1089] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:20 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:21.113750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.114581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.115017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.115390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.116222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:21.116655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.116770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.118210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.127750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 532/1090] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:28:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 340 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:21.133487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.267500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff434cc-2678-4169-bbf2-d125687863cd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.273424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db337950-5f8c-4dcc-bb92-f2021b8bced5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.299693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.311621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.313109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.313604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.314097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.321762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.322708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.323058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.323399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.326083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.329147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:21.338024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:21.340060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:21.341778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:21.343704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.343841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 559/1091] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:21.343993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.348681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:21.363388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:21.365452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:21.366583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:21.366583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:21.366583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:21.366583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:21.366583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 533/1092] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:21.374468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.472452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09efafa-c25b-4ffd-9dd8-cc9991407837 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.510171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dacbae-21b2-4c9a-af29-9130908fb6a9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.528778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.529446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.529871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.530290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.531259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:21.531699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.533426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.543267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 560/1093] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:21.549964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.557421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.558413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.558808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.559186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.560028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:21.560484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.562842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.577967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 534/1094] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:21.583738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.639959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.651338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.711652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a19be-b952-4a9b-8796-8f1ac1367baa None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.725586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4f55a-5dcf-476d-890b-59769c922a19 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.751825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.752904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.753298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.753649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] PATH_INFO: `/v3/users/ac3cb389682b485698b2ef43b7048ab8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.755086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] RBAC: Authorizing `identity:get_user(user_id=ac3cb389682b485698b2ef43b7048ab8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.756660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.758376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 561/1095] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/users/ac3cb389682b485698b2ef43b7048ab8 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:21.764777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.773563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.774931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.775442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.775819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.789655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:21.791748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:28:21.821130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:21.822596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:21.823874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 535/1096] 10.222.0.102 () {56 vars in 1098 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:21.829508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:21.900564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941fe20-66d4-4786-aebf-29c23f834c25 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.927713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:21.949742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765eff8a-1900-4638-8924-5aeffd73b0f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:21.953346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:21.954132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:21.954499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:21.954957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:21.962655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.003405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.004356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.004790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.005164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.006134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.006633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.008978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.030012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 536/1097] 10.222.0.102 () {56 vars in 1138 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:22.036929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.045683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.048343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.188551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ced9f-8c4d-4ea4-a8fe-aa773da6e5d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.197086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 562/1098] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:21 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:28:22.204162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.230441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.240201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.241138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.241510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.241834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.282862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.333942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.335102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca6cd4e-8e24-4aaa-ac86-eb01becf1dc8 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.335593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.377930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.379165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.379568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.379944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.381537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.383121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.385569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 563/1099] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:22.394658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.461068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 537/1100] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:28:22.467940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.501549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.522578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425924a-e662-4535-a0fa-e58142eeb397 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.538594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:22.565268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.566248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.566628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.567082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.568507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414, user.id=ac3cb389682b485698b2ef43b7048ab8) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.569023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.571447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.592904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 564/1101] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/role_assignments?user.id=ac3cb389682b485698b2ef43b7048ab8&scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:22.597485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7f4b8-6c8b-48cf-9613-702f8517309d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.658398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.659335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.659692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.660039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.674767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.676398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:22.698773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:22.700492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:22.702377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:28:22.702377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:22.702377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:28:22.702377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:22.702377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 538/1102] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:28:22.710174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:22.859039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24f6aa-341b-4b6d-a952-74ee4d8a4358 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:22.897568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:22.898251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:22.898537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:22.898812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:22.899567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:22.899876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:22.901327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:22.916291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 565/1103] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:22.923612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.093797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d1cb1-0f0f-4d24-936f-85e9e6ca6ce2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.114287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.136122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.137110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.137482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.137856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.146297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.147904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:28:23.164023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:23.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:23.168011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 539/1104] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:23.174108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.188011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:23.325827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c0f98-9d4c-41b1-a286-a0d9594f750a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.367622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.368209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.368527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.368810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.369609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:23.369924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.371423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b056b-d59e-4eb5-b8cb-d5399af4766b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.384391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 566/1105] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:23.390778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:23.504666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859f9dd-3b07-489d-9321-d053e928067f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:23.540492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:23.541159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:23.541432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:23.541713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:23.542565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] RBAC: Adding query filter params (role.id=d2d369cb68e24222bd415a5d737502a2, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=bf8a03a9bb9848c0a51808883cb9f929) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:23.542886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:23.544352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59c08c-ee70-4625-bb46-2fec1c1a00e8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:23.551906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 540/1106] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:23 2022] GET /identity/v3/role_assignments?user.id=bf8a03a9bb9848c0a51808883cb9f929&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=d2d369cb68e24222bd415a5d737502a2 => generated 610 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:24.928580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd350d0-5f3b-4fa3-96f0-6670ed4d51a3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.929131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd350d0-5f3b-4fa3-96f0-6670ed4d51a3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.929131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd350d0-5f3b-4fa3-96f0-6670ed4d51a3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.930534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 567/1107] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:28:24.937433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:24.937981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:24.938447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:24.967527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:24.969901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:25.032926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.073004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 541/1108] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:24 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:25.099106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd350d0-5f3b-4fa3-96f0-6670ed4d51a3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.179071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:25.217407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd350d0-5f3b-4fa3-96f0-6670ed4d51a3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.257294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.258101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.258428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.258706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.259999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.261503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ac9b8-c1fd-4648-b2f1-22ad4b4ff723 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.263242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 568/1109] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:25 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:25.270084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:25.385818 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7f39-abaf-481f-aada-a71f5a7cb0f8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:25.424355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:25.425226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:25.425515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:25.425801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:25.426541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:25.428154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737742f-e50c-48b7-b2ff-19c9d1535ed3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:25.453971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 542/1110] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:28:25 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:28:27.805096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e057d-ac41-46b5-a69c-2031a71bb9a9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.805790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e057d-ac41-46b5-a69c-2031a71bb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.805790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e057d-ac41-46b5-a69c-2031a71bb9a9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.807034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 569/1111] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:27.813325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:27.814075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:27.814278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:27.831877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:27.833123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:27.854217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:27.915749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 543/1112] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:27.940947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e057d-ac41-46b5-a69c-2031a71bb9a9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.055717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e057d-ac41-46b5-a69c-2031a71bb9a9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.109326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.110300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.110582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.110951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] PATH_INFO: `/v3/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.113094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] RBAC: Authorizing `identity:get_role(role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.114775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.116870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 570/1113] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:27 2022] GET /identity/v3/roles/4adbf210244243b7a5724f918f6b9a5a => generated 224 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.123652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.248493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d1065-3f6c-4e70-9792-1745708a1bdc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.287632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.288550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.288832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.289113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] PATH_INFO: `/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.304744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] RBAC: Authorizing `identity:get_user(user_id=6c364d7f8d964aa7b9dfa16fba62ab15)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.306271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.308013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 544/1114] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15 => generated 287 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.314107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.323484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.418923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9874ed2-fc68-463a-9fb7-960cbbc14648 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.454733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.455385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.455675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.455966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.533416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.534881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.543204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.639895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 571/1115] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:28.646385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.664262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.753341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772d74a-e98a-4833-8be3-b1d2b68c73ba None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.790192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.791063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.791355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.791637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.792891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.794351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd633002-6686-40cd-ad25-a22c35d0fb30 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.796396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 545/1116] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:28.802973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:28.945125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26cc8c-7a26-4a35-8a62-792af7ebd783 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:28.953538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:28.983051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:28.983702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:28.983986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:28.984263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:28.985129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414, user.id=6c364d7f8d964aa7b9dfa16fba62ab15) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:28.985445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:28.986890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a95a7-2675-4225-afa5-2581d7957f2d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:28.992890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 572/1117] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:28 2022] GET /identity/v3/role_assignments?user.id=6c364d7f8d964aa7b9dfa16fba62ab15&scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.305490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ef69e-604f-4cae-bfb6-d4a7594caa32 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.306087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ef69e-604f-4cae-bfb6-d4a7594caa32 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.306087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ef69e-604f-4cae-bfb6-d4a7594caa32 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.307628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 546/1118] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:31.314439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.314878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.314998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.333557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:31.334791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:31.409102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 573/1119] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:31 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:31.432315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ef69e-604f-4cae-bfb6-d4a7594caa32 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.521495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.540702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ef69e-604f-4cae-bfb6-d4a7594caa32 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.574855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.576168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.576476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.576756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] PATH_INFO: `/v3/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.578231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] RBAC: Authorizing `identity:get_role(role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.579609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.581024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 547/1120] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/roles/4adbf210244243b7a5724f918f6b9a5a => generated 224 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.587077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.683404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:31.687209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faeaa28-3e42-4fb2-9996-020c0d8ed343 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.722290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.723150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.723431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.723707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] PATH_INFO: `/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.724931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] RBAC: Authorizing `identity:get_user(user_id=6c364d7f8d964aa7b9dfa16fba62ab15)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.726358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.727995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 574/1121] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.734590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.840629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7286f-e377-4f1b-a820-e160780ff614 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:31.876172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:31.877071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:31.877362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:31.877666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:31.878851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:31.880305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f3ee5-f489-401c-b6f7-3adb9698ad8b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:31.882136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 548/1122] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:31 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:31.888330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:31.988670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed23c4-8b46-464b-aa65-2ea1d1280cbf None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:32.023691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:32.024599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:32.024894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:32.025180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414/users/6c364d7f8d964aa7b9dfa16fba62ab15/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:32.027431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] RBAC: Authorizing `identity:create_grant(project_id=f17fcda32bcc4a3cb759d6e7e5738414, user_id=6c364d7f8d964aa7b9dfa16fba62ab15, role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:32.029455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd0c87-738a-43e5-a3f0-5d868cb9f602 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:32.044989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 575/1123] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:28:31 2022] PUT /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414/users/6c364d7f8d964aa7b9dfa16fba62ab15/roles/4adbf210244243b7a5724f918f6b9a5a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:34.280186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1945-ac0f-42cf-9b69-88ef5eb25da9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.280757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1945-ac0f-42cf-9b69-88ef5eb25da9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.281036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1945-ac0f-42cf-9b69-88ef5eb25da9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.282674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 549/1124] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:34.288583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.289333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.289526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.307614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:34.308838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:34.332406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.383546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 576/1125] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:34 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:34.408098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1945-ac0f-42cf-9b69-88ef5eb25da9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.429538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.519439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1945-ac0f-42cf-9b69-88ef5eb25da9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.556978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.557744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.558033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.558312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] PATH_INFO: `/v3/roles/4adbf210244243b7a5724f918f6b9a5a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.559841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] RBAC: Authorizing `identity:get_role(role_id=4adbf210244243b7a5724f918f6b9a5a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.561265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.562687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 550/1126] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/roles/4adbf210244243b7a5724f918f6b9a5a => generated 224 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.568792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.667774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064d0ac-766c-4fe8-86ce-06c62ab6b0fe None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.702949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.703820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.704106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.704403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] PATH_INFO: `/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.705602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6c364d7f8d964aa7b9dfa16fba62ab15)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.707059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:34.708749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 577/1127] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/users/6c364d7f8d964aa7b9dfa16fba62ab15 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:34.714960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:34.802648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:34.817560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fab8b7-252c-464f-b969-b87b4c4cc00c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:34.851683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:34.852334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:34.852656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:34.852937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:34.923627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:34.925145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.013421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.029698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 551/1128] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:34 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:35.035851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.063655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:35.142299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca613e68-200e-4475-91f4-8da63ccf86c5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.176150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.177042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.177328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.177605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] PATH_INFO: `/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.178804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] RBAC: Authorizing `identity:get_project(project_id=f17fcda32bcc4a3cb759d6e7e5738414)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.180239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e4d35-e93c-4a58-9200-da144ccee77e None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.182005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 578/1129] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/projects/f17fcda32bcc4a3cb759d6e7e5738414 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:35.188866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:35.293740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fce005-020a-4206-985c-3cc3ab0b7ff8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:35.331129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:35.331790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:35.332077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:35.332357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:35.333224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] RBAC: Adding query filter params (role.id=4adbf210244243b7a5724f918f6b9a5a, scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414, user.id=6c364d7f8d964aa7b9dfa16fba62ab15) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:35.333538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:35.334983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d311a59-6767-406b-8e3f-052efdb30539 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:35.341211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 552/1130] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:35 2022] GET /identity/v3/role_assignments?user.id=6c364d7f8d964aa7b9dfa16fba62ab15&scope.project.id=f17fcda32bcc4a3cb759d6e7e5738414&role.id=4adbf210244243b7a5724f918f6b9a5a => generated 610 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:37.698468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aecf-f1fb-4516-9e59-2f61a375b3cb None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.699056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aecf-f1fb-4516-9e59-2f61a375b3cb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.699056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242aecf-f1fb-4516-9e59-2f61a375b3cb None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.700962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 579/1131] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:37 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:37.707472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.708029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.708029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.727666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:37.729007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:37.784066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.807516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 553/1132] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:37 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:37.832139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242aecf-f1fb-4516-9e59-2f61a375b3cb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:37.940163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:37.949015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242aecf-f1fb-4516-9e59-2f61a375b3cb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:37.987428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:37.988221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:37.988545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:37.988821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:37.990023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:37.991460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edcd16d-2200-457d-b806-cc57e71b8aa4 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:37.993145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 580/1133] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:37 2022] GET /identity/v3/domains/default => generated 200 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:37.999703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:38.100951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4654d783-b78b-437d-b22d-c454f41a749d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:38.135634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:38.136310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:38.136632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:38.136916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:38.138184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:38.139637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad3583b-b389-466f-ad88-9297271319a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:38.167171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 554/1134] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:28:37 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:40.487580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76e0e-6387-4820-9222-b0376e8b0314 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.488144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76e0e-6387-4820-9222-b0376e8b0314 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.488144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee76e0e-6387-4820-9222-b0376e8b0314 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.489662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 581/1135] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:40.500670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.500670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.500670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.518823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:40.520102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:40.550249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:40.595038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 555/1136] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:40 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:40.620616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76e0e-6387-4820-9222-b0376e8b0314 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.730022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee76e0e-6387-4820-9222-b0376e8b0314 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.768584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.769596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.770709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.770709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.772113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.773368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f28c2-5c48-4003-97ed-8afaf0da98e8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.775032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 582/1137] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:28:40 2022] GET /identity/v3/domains/default => generated 200 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:40.781987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:40.884949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccc590-9e4f-4d5a-943a-6c542da86bb7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:40.922890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:40.923554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:40.923841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:40.924122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:40.924855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:40.926302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38898b-79c8-499a-9244-1f16723fe8c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:40.948913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 556/1138] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:28:40 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:43.301274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be3ec-f668-4d00-93a1-b4ccaa1c773c None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.301821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be3ec-f668-4d00-93a1-b4ccaa1c773c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.301940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72be3ec-f668-4d00-93a1-b4ccaa1c773c None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.303342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 583/1139] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:43 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:43.309679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.310186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.310272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.328589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:43.329818 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:43.345719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.403280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 557/1140] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:43 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:43.427622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be3ec-f668-4d00-93a1-b4ccaa1c773c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.459265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.533466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72be3ec-f668-4d00-93a1-b4ccaa1c773c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.568577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.569280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.569563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.569838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.580167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:43.588040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:43.590341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:43.592343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 584/1141] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:43.597901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.706762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73842-53dd-4ed0-bc7d-4a38238ef1b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.745104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.745784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.746250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.746535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.747306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:43.747621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.749075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.758542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 558/1142] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:43.765289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.864485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:43.874584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f38c1f-a99b-4425-ae38-b805a99ab5ba None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:43.910178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:43.911049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:43.911326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:43.911598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] PATH_INFO: `/v3/users/5373c3ce06e246e5b4d0860e0397ff2c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:43.926094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=5373c3ce06e246e5b4d0860e0397ff2c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:43.927547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:43.929569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 585/1143] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/users/5373c3ce06e246e5b4d0860e0397ff2c => generated 287 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:43.935663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:43.949018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.040328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2af4d9-cb5f-44ca-ab9d-170c0235f261 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.074018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.075241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.075523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.075798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.147624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.149030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.160826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.254663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 559/1144] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:43 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 16:28:44.260669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.364741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6642460-d77c-4066-857c-426e1bdea4e0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.399342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.400117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.400575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.400857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] PATH_INFO: `/v3/projects/09b9545d12c24591bb78dc61e27b1153` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.401909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] RBAC: Authorizing `identity:get_project(project_id=09b9545d12c24591bb78dc61e27b1153)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.403946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ee460-5a34-4ed2-aea3-e6c3da4bb999 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.405714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 586/1145] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/projects/09b9545d12c24591bb78dc61e27b1153 => generated 312 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:44.412493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:44.517107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09ce5-cc2c-4abf-9a5e-6d01d29943d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:44.529104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:44.554426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:44.555073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:44.555359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:44.555635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:44.556497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=09b9545d12c24591bb78dc61e27b1153, user.id=5373c3ce06e246e5b4d0860e0397ff2c) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:44.556813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:44.558263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bfb05-9c0b-48a9-ba2d-b8e7ef58c1e8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:44.564101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 560/1146] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:44 2022] GET /identity/v3/role_assignments?user.id=5373c3ce06e246e5b4d0860e0397ff2c&scope.project.id=09b9545d12c24591bb78dc61e27b1153&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:46.812750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3c3-b916-4ba1-a0ff-2e44d8f963b0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.813321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3c3-b916-4ba1-a0ff-2e44d8f963b0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.813321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209e3c3-b916-4ba1-a0ff-2e44d8f963b0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.814741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 587/1147] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:46 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:46.821050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:46.821625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:46.821625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:46.841170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:46.842439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:46.927048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 561/1148] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:46 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:46.950958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209e3c3-b916-4ba1-a0ff-2e44d8f963b0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:46.970665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.061430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209e3c3-b916-4ba1-a0ff-2e44d8f963b0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.096217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.096952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.097231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.097506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.108534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:47.116122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:47.117228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:47.118246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 588/1149] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:47.123705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.235066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211018c0-0eb9-407e-8a3f-18e534eb3d96 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.237650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.270533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.271201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.271485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.271767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.272553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:47.272865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.274266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.285253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 562/1150] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.294052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.375092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:47.399512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f2628-cde8-40df-a4a4-1af95e424cb5 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.435178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.436073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.436356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.436662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] PATH_INFO: `/v3/users/5373c3ce06e246e5b4d0860e0397ff2c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.437846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] RBAC: Authorizing `identity:get_user(user_id=5373c3ce06e246e5b4d0860e0397ff2c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.439269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.440972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 589/1151] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/users/5373c3ce06e246e5b4d0860e0397ff2c => generated 287 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.446768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.553531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167f1f-1259-4e22-98f2-e265f331a56c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.587580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.588473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.588761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.589037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] PATH_INFO: `/v3/projects/09b9545d12c24591bb78dc61e27b1153` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.590224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=09b9545d12c24591bb78dc61e27b1153)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.591683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaa8f0-6ad4-4d21-838d-1b924398f8a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.593453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 563/1152] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:47 2022] GET /identity/v3/projects/09b9545d12c24591bb78dc61e27b1153 => generated 312 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:47.599486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:47.708439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddc72b-9b84-4f3d-b99c-1c3dd51bdf77 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:47.740975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:47.741852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:47.742137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:47.742417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] PATH_INFO: `/v3/projects/09b9545d12c24591bb78dc61e27b1153/users/5373c3ce06e246e5b4d0860e0397ff2c/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:47.744345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=09b9545d12c24591bb78dc61e27b1153, user_id=5373c3ce06e246e5b4d0860e0397ff2c, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:47.746414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a77bbd-8e0f-4a56-8cd0-d75c0354bca5 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:47.759439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 590/1153] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:28:47 2022] PUT /identity/v3/projects/09b9545d12c24591bb78dc61e27b1153/users/5373c3ce06e246e5b4d0860e0397ff2c/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:28:49.946341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1030d-c756-4ba6-a748-b9d76531ca38 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.947040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1030d-c756-4ba6-a748-b9d76531ca38 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.947040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1030d-c756-4ba6-a748-b9d76531ca38 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.948279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 564/1154] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:49.954396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:49.954865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:49.954953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:49.960856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:49.973438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:49.974633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:50.044711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 591/1155] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:49 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:50.068652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1030d-c756-4ba6-a748-b9d76531ca38 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.104440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:50.171327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1030d-c756-4ba6-a748-b9d76531ca38 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.205251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.205954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.206238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.206522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.218370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:28:50.226244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:50.227516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:28:50.228820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 565/1156] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:50.233935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.338738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32984a1-6329-4259-bfbd-9c2e34b90f73 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.374360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.375027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.375313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.375590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.376341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:50.376678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:50.378078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:50.379643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:50.387894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 592/1157] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:28:50.393744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.490831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:50.498762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b033-b838-4a48-9053-e82b9b375ad0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.532004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.532896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.533182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.533459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] PATH_INFO: `/v3/users/5373c3ce06e246e5b4d0860e0397ff2c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.534639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5373c3ce06e246e5b4d0860e0397ff2c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:50.536090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:50.537756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 566/1158] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/users/5373c3ce06e246e5b4d0860e0397ff2c => generated 287 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:50.544017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.649075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8652c84-abab-45f4-9c86-1c7a442c5793 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.682088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.682733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.683659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.683941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.742450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:50.749762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:50.751234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:50.846123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 593/1159] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:50.852060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:50.951358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccd1b6-f91a-4d93-b8e2-152f83a570b5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:50.984632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:50.985481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:50.985768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:50.986044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] PATH_INFO: `/v3/projects/09b9545d12c24591bb78dc61e27b1153` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:50.987207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] RBAC: Authorizing `identity:get_project(project_id=09b9545d12c24591bb78dc61e27b1153)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:50.988677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c1e7b-9662-4ef7-8a1e-b41fa2478766 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:50.990370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 567/1160] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/projects/09b9545d12c24591bb78dc61e27b1153 => generated 312 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:50.996589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:51.086680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:51.093501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742722f3-7191-4efc-8757-edf8c28fde87 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:51.126076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:51.126797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:51.127099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:51.127376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:51.128194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=09b9545d12c24591bb78dc61e27b1153, user.id=5373c3ce06e246e5b4d0860e0397ff2c) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:51.128614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:51.130028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaccae-7add-4122-8817-11c7bbae01d8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:51.135668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 594/1161] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:28:50 2022] GET /identity/v3/role_assignments?user.id=5373c3ce06e246e5b4d0860e0397ff2c&scope.project.id=09b9545d12c24591bb78dc61e27b1153&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:53.358423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f658e-4abb-426d-8741-5c615b938138 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.358960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f658e-4abb-426d-8741-5c615b938138 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.358960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f658e-4abb-426d-8741-5c615b938138 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.360343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 568/1162] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:53.365648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.366097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.366256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.383696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:53.384946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:53.452678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 595/1163] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:53 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:28:53.475540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f658e-4abb-426d-8741-5c615b938138 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.508164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.579478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f658e-4abb-426d-8741-5c615b938138 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.624394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.625033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.625317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.625592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.692627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.694108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.722231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.791476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 569/1164] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:28:53.798436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:53.883536 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:53.893427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4348fb-cdba-49cb-be50-10ae4b55450b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:53.928152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:53.928983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:53.929267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:53.929545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:53.936135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:53.937610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-731a7369-15da-45d4-bfb3-62ad55976b77 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:28:53.951406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:28:53.952648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:28:53.953710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 596/1165] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:28:53.958677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:54.061345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3813fb6-2fb2-49d8-98f4-dc950bd6d944 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:54.089857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:54.096186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:54.096882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:54.097171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:54.097450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:54.098176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:28:54.098483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:54.099857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad42b3-8b7c-477a-bbcd-1ffb19842d41 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:54.107806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 570/1166] 10.222.0.102 () {56 vars in 1120 bytes} [Thu May 26 16:28:53 2022] GET /identity/v3/domains?name=swift_test => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:56.331760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc753d-ee04-4f82-9ed0-e092d2ab38dc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.332294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc753d-ee04-4f82-9ed0-e092d2ab38dc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.332425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc753d-ee04-4f82-9ed0-e092d2ab38dc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.333730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 597/1167] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:56.338992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d072-96f1-4b19-9d45-9fb11b9d1ee8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.339425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d072-96f1-4b19-9d45-9fb11b9d1ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.339568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2d072-96f1-4b19-9d45-9fb11b9d1ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.356605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-20f2d072-96f1-4b19-9d45-9fb11b9d1ee8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:56.357798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-20f2d072-96f1-4b19-9d45-9fb11b9d1ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:56.423192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 571/1168] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:56 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:56.446551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc753d-ee04-4f82-9ed0-e092d2ab38dc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:56.547149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc753d-ee04-4f82-9ed0-e092d2ab38dc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:56.579940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:56.580553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:56.580842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:56.581120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:56.581871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:56.583256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19e96-462e-4bea-b45c-e20232a69229 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:56.597655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 598/1169] 10.222.0.102 () {60 vars in 1143 bytes} [Thu May 26 16:28:56 2022] POST /identity/v3/domains => generated 268 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:28:58.832067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bc96-0960-44e6-89b4-0734830b3e01 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.832689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bc96-0960-44e6-89b4-0734830b3e01 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.832689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2bc96-0960-44e6-89b4-0734830b3e01 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.834046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 572/1170] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:28:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:28:58.839443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:58.839891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:58.840011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:58.857237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:28:58.858443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:28:58.861417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:58.926710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 599/1171] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:28:58 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:28:58.950735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2bc96-0960-44e6-89b4-0734830b3e01 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.057101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2bc96-0960-44e6-89b4-0734830b3e01 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.083890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.096729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.097607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.097899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.098184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] PATH_INFO: `/v3/domains/7884d09b9e1842468395a692f41ab19f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.110427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] RBAC: Authorizing `identity:get_domain(domain_id=7884d09b9e1842468395a692f41ab19f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.112024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b60128-c442-4ab4-8e51-824beb9fc48d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.113840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 573/1172] 10.222.0.102 () {56 vars in 1188 bytes} [Thu May 26 16:28:58 2022] GET /identity/v3/domains/7884d09b9e1842468395a692f41ab19f => generated 268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:28:59.119863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:28:59.222124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4598ad-eff0-441c-a92c-73126031cd34 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:28:59.256020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:28:59.256708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:28:59.257013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:28:59.257286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:28:59.257998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:28:59.259440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c2e35-b822-4e9f-b22b-d892451c1de9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:28:59.268940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:28:59.285724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 600/1173] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:28:59 2022] POST /identity/v3/projects => generated 362 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:01.531136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f427-df1c-4564-bbee-661dc51bbd75 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.531688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f427-df1c-4564-bbee-661dc51bbd75 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.531688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f427-df1c-4564-bbee-661dc51bbd75 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.533109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 574/1174] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:29:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:01.538477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.538894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.539047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.556585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:01.558268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:01.625964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 601/1175] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:29:01 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:01.650760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f427-df1c-4564-bbee-661dc51bbd75 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.751099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f427-df1c-4564-bbee-661dc51bbd75 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.784178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.785060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.785350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.785634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] PATH_INFO: `/v3/domains/7884d09b9e1842468395a692f41ab19f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.786827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=7884d09b9e1842468395a692f41ab19f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.788282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9f3f-4617-4823-b6ca-c88eb4ca13ae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.789956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 575/1176] 10.222.0.102 () {56 vars in 1188 bytes} [Thu May 26 16:29:01 2022] GET /identity/v3/domains/7884d09b9e1842468395a692f41ab19f => generated 268 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:01.796508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:01.895755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aed6f9-2287-4c9c-b1e4-6f8b11f7d02d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:01.918814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:01.930905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:01.931572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:01.932452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:01.932738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:01.933453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:01.934900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba02ff-8699-4f19-afb4-9dd31d1f0c1b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:01.958059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 602/1177] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:29:01 2022] POST /identity/v3/users => generated 312 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:29:04.247555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d757e-8db4-469c-8716-3a8ff80a216e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.248093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d757e-8db4-469c-8716-3a8ff80a216e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.248093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d757e-8db4-469c-8716-3a8ff80a216e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.249513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 576/1178] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:29:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:04.254738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.255165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.255303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.272212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:04.273411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:04.342629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 603/1179] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:29:04 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:29:04.365958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d757e-8db4-469c-8716-3a8ff80a216e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.419134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.466438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d757e-8db4-469c-8716-3a8ff80a216e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.499969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.500688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.500981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.501261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.511940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:04.519705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:04.520917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:29:04.521992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 577/1180] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:04.527035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.625632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ee914-2299-4cd4-86d3-edc354870148 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.635878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.661234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.661900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.662185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.662460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.663200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:04.663507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.664924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.673848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 604/1181] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.679908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.779392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8f9df-8ae3-4b93-a460-7d9c8dd4404c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.792325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:04.815135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.816032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.816317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.816624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] PATH_INFO: `/v3/users/8871c72ad4f34958a023fdc3023b7196` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:04.829654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] RBAC: Authorizing `identity:get_user(user_id=8871c72ad4f34958a023fdc3023b7196)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:04.831097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:04.832815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 578/1182] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/users/8871c72ad4f34958a023fdc3023b7196 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:04.838813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:04.941006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402d6e6-8bf4-4b10-ab7b-e0257dfaaa56 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:04.976856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:04.977521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:04.977811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:04.978093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.021849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.053123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.054519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.155872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 605/1183] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:29:04 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:05.162054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.261078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6d84-3cfd-4f04-9868-e386f270a799 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.295362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.296225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.296544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.296826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] PATH_INFO: `/v3/projects/4f6d167b672a48a592bf9310f08762cc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.298019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] RBAC: Authorizing `identity:get_project(project_id=4f6d167b672a48a592bf9310f08762cc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.299462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34322f83-434f-42c7-a7e8-e6790666afdd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.301200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 579/1184] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/projects/4f6d167b672a48a592bf9310f08762cc => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:29:05.307580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:05.376454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:05.407147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd46e8d-0d83-47b4-982b-21c72233e4e3 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:05.439413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:05.440062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:05.440348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:05.440657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:05.441476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=4f6d167b672a48a592bf9310f08762cc, user.id=8871c72ad4f34958a023fdc3023b7196) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:05.441787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:05.443203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36ec9b-a828-4e83-aa5e-35f60560f204 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:05.449230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 606/1185] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:29:05 2022] GET /identity/v3/role_assignments?user.id=8871c72ad4f34958a023fdc3023b7196&scope.project.id=4f6d167b672a48a592bf9310f08762cc&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:07.629558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b647d-5ca3-4125-9941-a77d18c03f85 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.630079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b647d-5ca3-4125-9941-a77d18c03f85 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.630079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b647d-5ca3-4125-9941-a77d18c03f85 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.631484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 580/1186] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:29:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:07.637802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.638302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.638405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.656766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:07.657990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:07.729036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 607/1187] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:29:07 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:07.752053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b647d-5ca3-4125-9941-a77d18c03f85 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.798765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:07.859899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b647d-5ca3-4125-9941-a77d18c03f85 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:07.894347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:07.895048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:07.895341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:07.895625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:07.906227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:07.913804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:07.914940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:29:07.915995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 581/1188] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:07.921405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:07.982733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.021065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437c468-5716-4e77-8fb4-714a021b88e6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.054082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.054742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.055028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.055305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.056579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:08.056895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.058279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.067435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 608/1189] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:29:07 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.073987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.171136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.175379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53e9da-0c99-4646-92bd-3bffd8d19b8b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.211790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.213345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.213872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.214372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] PATH_INFO: `/v3/users/8871c72ad4f34958a023fdc3023b7196` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.216511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] RBAC: Authorizing `identity:get_user(user_id=8871c72ad4f34958a023fdc3023b7196)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.219245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.222305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 582/1190] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/users/8871c72ad4f34958a023fdc3023b7196 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.227985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.326890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af547ed0-1d4c-427a-af2a-e12ace581a01 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.351254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:08.360725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.361592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.361882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.362162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] PATH_INFO: `/v3/projects/4f6d167b672a48a592bf9310f08762cc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.363341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] RBAC: Authorizing `identity:get_project(project_id=4f6d167b672a48a592bf9310f08762cc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.364812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a1a49-c850-4085-9769-f60f42aae478 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.366524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 609/1191] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:29:08 2022] GET /identity/v3/projects/4f6d167b672a48a592bf9310f08762cc => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:08.372621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:08.471382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fb804-b2e5-4ee5-a73a-1d7b6d2e147f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:08.504885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:08.505765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:08.506053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:08.506335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] PATH_INFO: `/v3/projects/4f6d167b672a48a592bf9310f08762cc/users/8871c72ad4f34958a023fdc3023b7196/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:08.508292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] RBAC: Authorizing `identity:create_grant(project_id=4f6d167b672a48a592bf9310f08762cc, user_id=8871c72ad4f34958a023fdc3023b7196, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:08.509791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd8041d-b187-4722-8e23-5dd42fd772de None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:08.522549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 583/1192] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:29:08 2022] PUT /identity/v3/projects/4f6d167b672a48a592bf9310f08762cc/users/8871c72ad4f34958a023fdc3023b7196/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:29:10.713457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655122-fc72-4aaa-8224-635efa9b564e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.713970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655122-fc72-4aaa-8224-635efa9b564e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.713970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c655122-fc72-4aaa-8224-635efa9b564e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.715317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 610/1193] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:29:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:29:10.720741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.721181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.721294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.742554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:29:10.744420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:29:10.765131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:10.814648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 584/1194] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:29:10 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:29:10.839726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655122-fc72-4aaa-8224-635efa9b564e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:10.948805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c655122-fc72-4aaa-8224-635efa9b564e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:10.981904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:10.982580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:10.982860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:10.983136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:10.993105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:29:11.001226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:29:11.002378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:29:11.003461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 611/1195] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:29:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:29:11.008822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.114561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ccbe-ffe0-411c-9e93-becff15fb6a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.152020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.152723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.153014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.153293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.154058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.154371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.155795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.165054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 585/1196] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.172066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.236776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.281462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a90ea2-11b1-49ed-981e-9ebb3cb221f7 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.314487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.315356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.315638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.315913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] PATH_INFO: `/v3/users/8871c72ad4f34958a023fdc3023b7196` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.317110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=8871c72ad4f34958a023fdc3023b7196)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.318535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.320161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 612/1197] 10.222.0.102 () {56 vars in 1182 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/users/8871c72ad4f34958a023fdc3023b7196 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.325913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.345603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.426067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a65d65-b4c9-40ae-bf7f-328cc82b86cd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.458812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.459458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.459753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.460037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.527264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.528772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.548090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.626764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 586/1198] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:29:11.632770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.730888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725aef7b-ca39-4b9f-8239-09921d4cc6f6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.753048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.765240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.766094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.766376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.766647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] PATH_INFO: `/v3/projects/4f6d167b672a48a592bf9310f08762cc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.767806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] RBAC: Authorizing `identity:get_project(project_id=4f6d167b672a48a592bf9310f08762cc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.769259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279442a-5755-4fea-b504-1a3f0dee39fc None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.770940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 613/1199] 10.222.0.102 () {56 vars in 1191 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/projects/4f6d167b672a48a592bf9310f08762cc => generated 362 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:11.777080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:29:11.873496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c0504-cf26-48c2-9ca4-1ebb33eea0e4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:29:11.890355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:11.906997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:29:11.907649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:29:11.907941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:29:11.908227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:29:11.909105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=4f6d167b672a48a592bf9310f08762cc, user.id=8871c72ad4f34958a023fdc3023b7196) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:29:11.909426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:29:11.910866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1945d31-e139-4165-ae66-eee682f98efb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:29:11.916583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 587/1200] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:29:11 2022] GET /identity/v3/role_assignments?user.id=8871c72ad4f34958a023fdc3023b7196&scope.project.id=4f6d167b672a48a592bf9310f08762cc&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:29:21.761164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:29:21.914868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:13.903028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90390c3-4ce1-490a-b996-d0d8870ccaaf None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.903669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90390c3-4ce1-490a-b996-d0d8870ccaaf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.903669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90390c3-4ce1-490a-b996-d0d8870ccaaf None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.908426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 614/1201] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:13.911137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:13.911735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:13.911735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:13.929268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:13.930465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:14.023921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 588/1202] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:13 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:14.049881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90390c3-4ce1-490a-b996-d0d8870ccaaf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.214146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90390c3-4ce1-490a-b996-d0d8870ccaaf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.261094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.261902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.262257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.262531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.275920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.277914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:14.300306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:14.301873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:14.302845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:14.302845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:14.302845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:14.302845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:14.302845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 615/1203] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:14.308180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.443004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a106623-0484-4204-be5a-f8f3f1159f1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.486262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.496410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.497586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.498118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.498326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.499213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:14.499497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.501253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5c50-e425-4f84-aff3-fc82f31aa358 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.519087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 589/1204] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:14.526836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:14.597779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:14.660522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af438300-46f8-4a21-8e12-35d3ac5990ac None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:14.706031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:14.706031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:14.706031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:14.706031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:14.706484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:14.707095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa075df-5f4a-414e-81ef-534c4785f2d8 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:14.732807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 616/1205] 10.222.0.102 () {60 vars in 1137 bytes} [Thu May 26 16:30:14 2022] POST /identity/v3/users => generated 252 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:30:17.132048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9c68-c63b-450f-8e3d-2e02a9166540 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.132673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9c68-c63b-450f-8e3d-2e02a9166540 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.132673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b9c68-c63b-450f-8e3d-2e02a9166540 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.134246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 590/1206] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:17.139656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.140188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.140412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.157807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:17.159659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:17.239499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 617/1207] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:17 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:17.262870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9c68-c63b-450f-8e3d-2e02a9166540 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.406839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b9c68-c63b-450f-8e3d-2e02a9166540 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.450657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.451625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.451933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.452267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.467387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:17.476075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:17.477211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:17.478091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:17.483870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.486615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 591/1208] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:17.532501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.601617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13322d52-8f5e-4df9-a4e3-f5b4cc872899 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.638678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.639370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.639661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.639946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.640834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:17.641152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.643137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.652930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 618/1209] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:17.659522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:17.734620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:17.803055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79426b08-9650-4110-a025-02213d1ebb39 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:17.848227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:17.849087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:17.849380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:17.849670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:17.862468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:17.864241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:17.884720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:17.885724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:17.886621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:17.886621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:17.886621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:17.886621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:17.886621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 592/1210] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:17.891737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:18.002177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:18.005532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001663b-a82f-40ca-bcae-448b073a4a37 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:18.044253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:18.045112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.045500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.045881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.046719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:18.047145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:18.048636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:18.061676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 619/1211] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:18.069042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:18.199754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6bd6-4f9d-4ea7-88d8-e37b9716f061 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:18.202050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:18.251390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:18.252756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.252992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.253275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.266167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:18.267722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:18.287719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:18.289025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:18.295322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 593/1212] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:18.297975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:18.412757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8d9c0-d1f7-44d9-8bec-8722c0dde7d6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:18.455266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:18.456184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.456306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.456629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.457605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:18.457822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:18.459341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:18.491540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 620/1213] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:18.493381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:18.634837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f85c6e2-3674-42d9-a52d-16c743259a7c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:18.686088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:18.686759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:18.687050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:18.687360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:18.725645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:18.794535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:18.796585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:18.937358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 594/1214] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:30:18 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:18.943088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:18.968949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.084458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23059dc-400d-42ba-bc3c-74ad69847f19 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.137249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.138687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.138687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.138987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.156437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.158278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:19.200233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:19.202231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:19.204194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:19.204194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:19.204194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:19.204194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:19.204194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 621/1215] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:19.212140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.305587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.364055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bc354-5644-47e3-b65e-a5948601076c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.426792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.427101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.427395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.427688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.428478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:19.428754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.430680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.450737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 595/1216] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:19.452405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.571967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.614602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0c32d-04b6-4888-93a1-fdff3e2bdf6d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.673989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.675440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.675880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.676305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.684904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.686565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:19.706287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:19.707534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:19.709100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 622/1217] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:19.710597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:19.832505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65476a-cde4-404f-9cac-e7bbf4c6a04a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:19.861531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:19.880258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:19.881208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:19.881463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:19.881908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:19.885129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:19.885129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:19.885129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72149e3-e13e-419e-86f5-89c1b6cc7432 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:19.899780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 596/1218] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:19.908881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:20.043246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57265dcb-8c66-4fbf-8d3f-4a79279c893d None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:20.080687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:20.088265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:20.089733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:20.090521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:20.090957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:20.092113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=5b1115a902664ed991ab40344b36cd60) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:20.092607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:20.094185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289c1a6-85aa-4257-9135-5edc1958a26b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:20.101440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 623/1219] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:30:19 2022] GET /identity/v3/role_assignments?user.id=5b1115a902664ed991ab40344b36cd60&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:22.350553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ef81-6ef6-413c-a741-f33329b69662 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.351104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ef81-6ef6-413c-a741-f33329b69662 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.351104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638ef81-6ef6-413c-a741-f33329b69662 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.352710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 597/1220] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:22.358311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.358749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.358879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.379814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:22.381423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:22.466684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 624/1221] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:22 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:22.491157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638ef81-6ef6-413c-a741-f33329b69662 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:22.614926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638ef81-6ef6-413c-a741-f33329b69662 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:22.652801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:22.653670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.653988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.654289 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.670646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:22.692259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:22.693439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:22.694379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:22.695113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 598/1222] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:30:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:22.703276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:22.855542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8415ef-ffcb-4bf9-ae9b-27ac736b87af None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:22.886900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:22.900738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:22.901583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:22.901923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:22.902290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:22.903225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] RBAC: Adding query filter params (name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:22.903532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:22.905073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:22.915757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 625/1223] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:30:22 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:22.922640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:22.974511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.039618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85707fa-49c1-49ad-8953-b7df21db62cc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.076848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.077637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.077924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.078199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.090463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.092150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:23.115671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:23.116895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:23.117938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:23.117938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:23.117938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:23.117938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:23.117938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 599/1224] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:23.125090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.240543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3643e-28df-4e32-8f41-7c7d8536c570 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.275834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.276536 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.276834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.277108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.277842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:23.278153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.279570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.300416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 626/1225] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:23.304722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.449993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.460994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82a016-ebc1-4722-9059-0e38793bb4d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.510927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.512323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.512896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.513256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.525771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.527964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:23.544146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:23.545709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:23.547274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:23.550350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 600/1226] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:23.551762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.606705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:23.672521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a0ab1-6558-4c8b-9146-17f97121afc9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.717110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.717819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.718144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.718578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.719544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:23.720598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.723885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.743783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 627/1227] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:23.753122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:23.900221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3025ec8d-a6b5-4ed8-8441-257abea04607 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:23.933616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:23.934398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:23.934683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:23.934963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:23.946843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:23.948335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:23.970183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:23.971370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:23.972327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:23.972327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:23.972327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:23.972327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:23.972327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 601/1228] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:23.977850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.113313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8afa6-4c1e-45bb-8d3d-c97dc6411130 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.117117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.159663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.160224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.160543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.160826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.161556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:24.162124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.164016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.178080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 628/1229] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:24.184815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.195954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.306272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa4225-db88-4b7c-a3ff-d15c0543e5bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.357771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.358680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.358979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.359330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.367555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.369245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:24.386022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:24.387328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:24.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 602/1230] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:24.393647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.507410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09842a9-69f8-4d25-b821-59b7cad7ce7f None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.562298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.563126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.563501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.563809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.564895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:24.565210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.566871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813385ee-0760-4fae-84e4-6de2c50e855a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.583531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 629/1231] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:24.590726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:24.683127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:24.731673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f27eba-7c4f-49ca-890d-710134b6a68f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:24.771082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:24.771883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:24.772165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:24.772484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/5b1115a902664ed991ab40344b36cd60/roles/0bc74bf281424a2a9946a916feb47616` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:24.792280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=5b1115a902664ed991ab40344b36cd60, role_id=0bc74bf281424a2a9946a916feb47616)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:24.794206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b7e7b-d75f-4906-ab8f-066716ed27b0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:24.809508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 603/1232] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:30:24 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/5b1115a902664ed991ab40344b36cd60/roles/0bc74bf281424a2a9946a916feb47616 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:30:27.229094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb36d-5826-4119-ad80-089383ee3405 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.229671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb36d-5826-4119-ad80-089383ee3405 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.229671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb36d-5826-4119-ad80-089383ee3405 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.231443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 630/1233] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:27.238718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.240771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.240771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.260136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:27.261408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:27.350500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 604/1234] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:27 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:27.379361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb36d-5826-4119-ad80-089383ee3405 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.414933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.511345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb36d-5826-4119-ad80-089383ee3405 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.555937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.556968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.557292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.557580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.568980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:27.576832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:27.577876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:27.578814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 631/1235] 10.222.0.102 () {56 vars in 1107 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:27.585422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.644347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.717939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f70291-64ea-4ff4-9a9c-e63edea7c1d1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.762973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.763861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.764291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.764761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:27.765716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:27.766055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:27.767975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:27.784429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 605/1236] 10.222.0.102 () {56 vars in 1108 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:27.787364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:27.919119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:27.943378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868375e4-86fd-4d8e-a65c-2e8d2e4478c0 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:27.995495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:27.996599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:27.996948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:27.997334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.011054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.014304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:28.036720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:28.037960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:28.039028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:28.039028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:28.039028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:28.039028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:28.039028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 632/1237] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:28.046131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.235487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214bb22-a09c-4558-b8f3-ba09229f2b04 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.256126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.306053 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.307117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.307117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.307301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.309250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:28.312255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.314376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.329672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 606/1238] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.336063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.469571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165cb6c-6259-42af-b47f-b833152a3035 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.515417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.516832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.517126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.517412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.520660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:28.527879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.529988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:28.547423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:28.549021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:28.549985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 633/1239] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:28.554921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.703358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2c7c8-5aa3-45ed-b55c-45b5e12deebc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.759610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.760301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.760638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.760924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:28.761787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:28.762125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:28.763587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:28.788426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 607/1240] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:28.794542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:28.945159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0ef75-2609-4bbb-a208-f20b6b7aec74 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:28.992195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:28.993006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:28.993593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:28.993740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.079532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.088484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.089942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.221762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 634/1241] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:30:28 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:29.227782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.274325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.404098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d820-e827-44c1-aff3-60922daa0941 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.448433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.449268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.449556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.449840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.461641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.463181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:29.483041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:29.485421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:29.486529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:29.486529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:29.486529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:29.486529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:29.486529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 608/1242] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:29.490484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.613013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.621414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eded3b-fdb6-4268-85f5-686cfceaf8bd None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.667306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.668307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.668691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.669081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.669855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:29.670235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.671926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.687954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 635/1243] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:29.696215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:29.811376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:29.845250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d390ace-ff1c-4a07-8f57-a2aadc5d027d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:29.894676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:29.896799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:29.896799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:29.896799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:29.905255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:29.907279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:29.925079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:29.926088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:29.927310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 609/1244] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:29.933871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.066885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c9c25-2352-47b1-a4c0-0373abd7613b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.112406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.113105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.113398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.113678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.114478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:30.114815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.116253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3ef88-9d1a-436e-a96d-70405d852be0 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.130670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 636/1245] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:30.136841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:30.266779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef139c-b09a-4605-82de-4b1f81255e9f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:30.321808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:30.322635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:30.322867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:30.323208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:30.324603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] RBAC: Adding query filter params (role.id=0bc74bf281424a2a9946a916feb47616, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=5b1115a902664ed991ab40344b36cd60) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:30.324949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:30.326645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a76bd-af79-4eea-865d-c83d95a649b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:30.334860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 610/1246] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:30:30 2022] GET /identity/v3/role_assignments?user.id=5b1115a902664ed991ab40344b36cd60&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=0bc74bf281424a2a9946a916feb47616 => generated 610 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:32.757634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0a63-d20d-489d-86ec-b13c1cd08895 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.759675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0a63-d20d-489d-86ec-b13c1cd08895 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.759675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb0a63-d20d-489d-86ec-b13c1cd08895 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.760910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 637/1247] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:32 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:32.767317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:32.767834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:32.767912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:32.773455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:32.787648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:32.788941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:32.882938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 611/1248] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:32 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:32.908112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0a63-d20d-489d-86ec-b13c1cd08895 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:32.937372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.072121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb0a63-d20d-489d-86ec-b13c1cd08895 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.120133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.121374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.121768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.122055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.136600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:33.145933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:33.146974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:33.147823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 638/1249] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:33.153741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.279794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245780d-97cb-4be0-bd2f-a34d5b89a5ea None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.322431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.327971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.329711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.330355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.330816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.331793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:33.332140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.333894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.342875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 612/1250] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:33.350015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.455719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.485379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79573654-800d-4a6e-b8da-ef04c7b9cf2b None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.531938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.532960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.533204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.533495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.547567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.549398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:33.569514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:33.570554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:33.571466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:33.571466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:33.571466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:33.571466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:33.573281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 639/1251] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:33.580523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.693203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c37c2-fc6f-488c-b6f3-7cc23b2b1a61 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.731844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.732609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.732898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.733179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.733923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:33.734259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.735795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.750329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 613/1252] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:33.757904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:33.881022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27575-0e11-4448-8f6d-55ad5c8288bb None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:33.912104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:33.923237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:33.924339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:33.924748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:33.925209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:33.936740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:33.939017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:33.956112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:33.957310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:33.958246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:33.960648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 640/1253] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:33.964079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:34.039835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.096405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea094e7-c0a2-43be-815a-750117abf96e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:34.141756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:34.142369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.142656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.142936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.145381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:34.145381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:34.145617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:34.167228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 614/1254] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:34.173810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:34.331874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2de31-8874-470b-8e50-0bdf64c65e46 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:34.378119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:34.379055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.379380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.379713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.446974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.463791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:34.466765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:34.596813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 641/1255] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:30:34 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:34.603186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:34.721793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bccd9d-c887-4233-9d8c-4f962ca401f1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:34.741447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.781935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:34.784709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.784709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.784709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.796093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:34.797717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:34.817020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:34.818441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:34.819342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:34.819342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:34.819342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:34.819342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:34.819342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 615/1256] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:34.824423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:34.932569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:34.951567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679c646-2671-4d21-ac0e-9edfe923d0e9 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:34.993923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:34.994723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:34.995068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:34.995410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:34.996255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:34.996641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:34.998114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.011071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 642/1257] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:34 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:35.017868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.142361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae81b63-4a95-4b52-a850-c3e834288de0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.189944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.190757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.191041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.191320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.200907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.202648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:35.221508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:35.222742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:35.224022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 616/1258] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:35.229935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.366517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816adc3-b3fd-45fc-a228-14acbdcfa302 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.410635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.411441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.411915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.412634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.413842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:35.414154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.418369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5570de-e014-4811-9177-79a6f14b0b82 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.434772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 643/1259] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:35.440647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:35.475006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:35.597663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194aedf-f96f-4102-b2c3-1f75eb15bc0c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:35.652874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:35.653646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:35.653984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:35.654386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:35.655235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=5b1115a902664ed991ab40344b36cd60) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:35.655552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:35.657641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a802d-3f3e-4203-b75c-e381d4c4f67b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:35.668405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 617/1260] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:30:35 2022] GET /identity/v3/role_assignments?user.id=5b1115a902664ed991ab40344b36cd60&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:38.179352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf93c5-9ec1-49b3-b1eb-f8a80caa107d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.179976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf93c5-9ec1-49b3-b1eb-f8a80caa107d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.179976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf93c5-9ec1-49b3-b1eb-f8a80caa107d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.181491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 644/1261] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:38 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:30:38.187376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.188138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.188324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.206149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:38.207363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:38.281192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 618/1262] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:38 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:38.305277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf93c5-9ec1-49b3-b1eb-f8a80caa107d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.323670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.428302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf93c5-9ec1-49b3-b1eb-f8a80caa107d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.469948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.470772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.471063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.471347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.483473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:38.492142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:38.493366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:38.494678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 645/1263] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:38.499973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.526112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.612962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07be12-d499-414a-8a0f-25dcc9a649f5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.649580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.650244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.650530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.650814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.651558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:38.651864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.653271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.663028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 619/1264] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:38.670000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.743194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:38.782737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8516641-e9d2-4455-aa89-558717cbfe0e None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:38.822233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:38.823423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:38.823717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:38.824038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:38.842916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:38.845296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:38.868897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:38.871065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:38.872360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:38.872360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:38.872360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:38.872360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:38.872360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 646/1265] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:38.878544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:38.996949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:39.021043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8786a033-49a9-4de9-96c3-e97652b7de83 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:39.060062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:39.060870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:39.061169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:39.061450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:39.062822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:39.063209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:39.064702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:39.080919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 620/1266] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:39.089896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:39.223622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a3292-bc25-496e-b859-b81a3339742a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:39.255137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:39.271490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:39.272396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:39.272842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:39.273170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:39.282064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:39.283530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:39.299810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:39.301593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:39.302595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 647/1267] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:39.307598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:39.433979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8851d3-f7e4-4209-992b-9c01efd723f0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:39.475238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:39.475924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:39.476210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:39.476703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:39.477413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:39.477731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:39.479226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:39.490492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:39.501411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 621/1268] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:39.507496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:39.620251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90423400-918e-471f-a36c-6cfc4dd0a060 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:39.659286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:39.660153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:39.660468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:39.660997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:39.675457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:39.677121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:39.698210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:39.699602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:39.701877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:39.701877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:39.701877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:39.701877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:39.701877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 648/1269] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:39.705823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:39.820102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255860a-c2df-4a14-b403-082325fed65a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:39.874820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:39.875651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:39.876034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:39.876427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:39.877296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:39.877693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:39.879209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:39.893732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 622/1270] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:39 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:39.899875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:39.936052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.018018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4bf2e-a85a-4441-9501-f65b491537b2 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.060484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.061357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.061726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.062049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.070377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.071858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:40.089255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:40.090967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:40.092997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 649/1271] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:40.099407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.167696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.214963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa882fb-b214-4c95-b41b-c4b9e195e139 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.252415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.253079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.253442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.253729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.254534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:40.254847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.256413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22671f9b-b6e1-4efa-981e-ca412a4e25b7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.270702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 623/1272] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:40.279961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:40.382719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:40.392906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc925b-446c-47b2-b943-69074302a87a None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:40.431870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:40.432837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:40.433153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:40.433502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] PATH_INFO: `/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/5b1115a902664ed991ab40344b36cd60/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:40.435605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] RBAC: Authorizing `identity:create_grant(project_id=6e1b239e39e344b8978ca7835fdf0ae6, user_id=5b1115a902664ed991ab40344b36cd60, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:40.437320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52bb5d-1f6f-4f2b-84ad-ccc5e9b03f6c None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:40.452626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 650/1273] 10.222.0.102 () {58 vars in 1444 bytes} [Thu May 26 16:30:40 2022] PUT /identity/v3/projects/6e1b239e39e344b8978ca7835fdf0ae6/users/5b1115a902664ed991ab40344b36cd60/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:30:42.883131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896179-b2f6-416f-8f64-d6b58bf66653 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.883879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896179-b2f6-416f-8f64-d6b58bf66653 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.884238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf896179-b2f6-416f-8f64-d6b58bf66653 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.887087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 624/1274] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:42 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:42.897151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:42.897961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:42.898273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:42.921652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:42.923200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:43.009516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 651/1275] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:42 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:43.033429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896179-b2f6-416f-8f64-d6b58bf66653 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.184741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf896179-b2f6-416f-8f64-d6b58bf66653 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.205806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:43.228874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.229856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.230041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.230289 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.242896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 16:30:43.251605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:43.253457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:43.255212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 625/1276] 10.222.0.102 () {56 vars in 1101 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:43.260477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.358523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:43.381475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2c67f-8c5f-4cf3-821a-9f6ed0c87cd9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.422205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.422891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.423176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.423452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.424337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:43.424683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:43.426248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.438336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 652/1277] 10.222.0.102 () {56 vars in 1104 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:43.445257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.576160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d27b5-b4b2-491c-a819-435ed5e4d9db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.625948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.626877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.627165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.627511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.641649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:43.643321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:43.665324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:43.667181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:43.669329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:43.669329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:43.669329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:43.669329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:43.669329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 626/1278] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:43.674704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.794670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39b696-4049-410e-9157-6c19de86f3f1 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:43.837160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:43.837888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:43.838299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:43.838884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:43.839867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:43.840248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:43.842232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:43.861221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 653/1279] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:43.868354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:43.913080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:43.990275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09cafe-41e4-4bed-b2fb-1a80948f90d7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.028161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.029026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.029339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.029668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.038481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.040105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 16:30:44.056191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:44.057429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:44.058909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 627/1280] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:44.064879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.070929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.180970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f7c01-377a-4754-8b50-bc128c07a826 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.218748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.219535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.219821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.220096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.221076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:44.221388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.222868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.243943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 654/1281] 10.222.0.102 () {56 vars in 1148 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:44.250258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.351819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.361935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e53a1-1e14-48b3-8376-ea4a3015d4ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.399584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.400243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.400565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.400845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.475573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.477201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.575983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.587349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 628/1282] 10.222.0.102 () {58 vars in 1287 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/auth/tokens => generated 2113 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 16:30:44.593383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.659036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:44.703660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf341888-2d40-4f08-ade6-6edc24a19465 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.741572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.742526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.742914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.743196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.756081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.757598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 16:30:44.776783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:44.777941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:44.779215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 16:30:44.779215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 16:30:44.779215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 16:30:44.779215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:44.779215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 655/1283] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:44.785361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:44.914280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6fcc5-caf4-4df1-ab80-8fade6647f84 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:44.955111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:44.955834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:44.956201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:44.956624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:44.957513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:44.957938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:44.959472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:44.974419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 629/1284] 10.222.0.102 () {56 vars in 1114 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:44.980173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.094476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f517de-5afa-40be-81dc-f34f3a2b69df None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.111517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.142879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.143911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.144328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.144953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.153804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.155348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 16:30:45.172713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application with Lock( May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:45.173965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: ERROR keystone.server.flask.application May 26 16:30:45.175152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 656/1285] 10.222.0.102 () {56 vars in 1116 bytes} [Thu May 26 16:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:45.185030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.292133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:45.406793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4304-186b-457a-8871-0671c48613d6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.472290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.473639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.474156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.474715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.476222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:45.476850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.479207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f5387c-20a3-4601-b859-1976505cbbe7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.503757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 630/1286] 10.222.0.102 () {56 vars in 1153 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:45.512764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:45.642702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9ba46-7d4c-4435-865d-aa48c5674a52 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:45.684574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:45.685241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:45.685530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:45.685806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:45.686918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] RBAC: Adding query filter params (role.id=eaf57d93779844cb9e5ee49e1067457b, scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6, user.id=5b1115a902664ed991ab40344b36cd60) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:45.687249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:45.688831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4b0e-a0e9-4614-80e1-b04176fa27ef None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:45.695908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 657/1287] 10.222.0.102 () {56 vars in 1379 bytes} [Thu May 26 16:30:45 2022] GET /identity/v3/role_assignments?user.id=5b1115a902664ed991ab40344b36cd60&scope.project.id=6e1b239e39e344b8978ca7835fdf0ae6&role.id=eaf57d93779844cb9e5ee49e1067457b => generated 610 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:48.131522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8c36-07f7-4ea2-9980-cf7a25bd0a81 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.132132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8c36-07f7-4ea2-9980-cf7a25bd0a81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.132545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed8c36-07f7-4ea2-9980-cf7a25bd0a81 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.135057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 631/1288] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:48 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:48.143949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.144525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.144632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.163456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:48.164781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:48.203762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:48.251340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 658/1289] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:48 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 16:30:48.274641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed8c36-07f7-4ea2-9980-cf7a25bd0a81 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:48.393215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed8c36-07f7-4ea2-9980-cf7a25bd0a81 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:48.406438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:48.436573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:48.437672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.437987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.438259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.439031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:48.440535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:48.454005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:48.455336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:48.456232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 632/1290] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:30:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:48.461932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:48.576067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554309c-9e62-42e1-83b9-99ec7c721e6f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:48.616567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:48.617240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.617529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.617877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.618534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:48.618867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:48.620236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5c48a-13a6-4831-96b9-69dfb2ee3e05 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:48.626232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 659/1291] 10.222.0.102 () {56 vars in 1121 bytes} [Thu May 26 16:30:48 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:48.633356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:48.744397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96447c6e-a837-4511-ba67-fb4cb876866a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:48.781182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:48.781882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:48.782202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:48.782484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:48.783236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] RBAC: Adding query filter params (type=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:48.783587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:48.785302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152901-c267-45ab-9e05-86153291e8ca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:48.791031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 633/1292] 10.222.0.102 () {56 vars in 1121 bytes} [Thu May 26 16:30:48 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:51.103126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e129-9f0a-4bc2-a7dd-a7690d9cf6dd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.103788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e129-9f0a-4bc2-a7dd-a7690d9cf6dd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.103892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e129-9f0a-4bc2-a7dd-a7690d9cf6dd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.105714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 660/1293] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:51 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:30:51.113828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9143-c48a-4e35-b62b-bd011431b52a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.114584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9143-c48a-4e35-b62b-bd011431b52a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.114584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db9143-c48a-4e35-b62b-bd011431b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.133092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-36db9143-c48a-4e35-b62b-bd011431b52a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:51.134362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36db9143-c48a-4e35-b62b-bd011431b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:51.168920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:51.213160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 634/1294] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:51 2022] POST /identity/v3/auth/tokens => generated 2113 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:51.237295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e129-9f0a-4bc2-a7dd-a7690d9cf6dd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:51.274418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:51.356735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581e129-9f0a-4bc2-a7dd-a7690d9cf6dd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:51.395067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:51.395796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:51.396112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:51.396404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:51.397151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:51.398604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e25506-13e3-46a9-bc53-234cd847de49 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:51.413795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 661/1295] 10.222.0.102 () {60 vars in 1146 bytes} [Thu May 26 16:30:51 2022] POST /identity/v3/services => generated 247 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:30:53.760941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8241a9-0d7b-40f1-bc0d-ac3903bf9f1c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:53.761501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8241a9-0d7b-40f1-bc0d-ac3903bf9f1c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:53.761501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8241a9-0d7b-40f1-bc0d-ac3903bf9f1c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:53.762878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 635/1296] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:53.768729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:53.769210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:53.769352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:53.788827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:53.790158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:53.873736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 662/1297] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:53 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:53.897008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8241a9-0d7b-40f1-bc0d-ac3903bf9f1c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.021702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8241a9-0d7b-40f1-bc0d-ac3903bf9f1c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.057552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.058868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.059288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.059630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.060410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.062032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:54.076689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:54.079223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:54.081337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 636/1298] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:30:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 16:30:54.084570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.104304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:54.195567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd4dd9-25a4-4e9b-b8c3-2ab25e986db2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.235592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.236271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.236588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.236874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.237600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:54.237908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.239301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.244968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 663/1299] 10.222.0.102 () {56 vars in 1121 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:30:54.253174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.292719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:54.377507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26477d84-e2c2-4873-a2c3-06acc553eb0a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.417255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.417964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.418260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.418543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.419452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] RBAC: Adding query filter params (interface=public, service_id=fa7418b961b8484ca7a8f4e49041e5de, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:54.419766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.421186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec03d7-51bc-43d4-8875-b78db0b2713e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.426842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 637/1300] 10.222.0.102 () {56 vars in 1256 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/endpoints?service_id=fa7418b961b8484ca7a8f4e49041e5de&interface=public®ion_id=RegionOne => generated 195 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:54.433140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:54.527035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:54.547339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ee6fe-ae43-41c5-af96-77c5f839efc6 None admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:54.590650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:54.591463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:54.591787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:54.592105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:54.592872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:54.594336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f016-94da-4c05-aa24-0339bbfc2407 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:54.603201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 664/1301] 10.222.0.102 () {56 vars in 1092 bytes} [Thu May 26 16:30:54 2022] GET /identity/v3/services => generated 2201 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:30:56.856049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522f73-4a5d-4d70-bb22-c4474c07959a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:56.856705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522f73-4a5d-4d70-bb22-c4474c07959a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:56.856705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e522f73-4a5d-4d70-bb22-c4474c07959a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:56.858054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 638/1302] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:30:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:30:56.863773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:56.864292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:56.864457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:56.885399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:30:56.886771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:30:56.959895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 665/1303] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:30:56 2022] POST /identity/v3/auth/tokens => generated 2216 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 16:30:56.983921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522f73-4a5d-4d70-bb22-c4474c07959a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:57.090690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:57.103409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e522f73-4a5d-4d70-bb22-c4474c07959a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:57.152589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:57.153855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.154358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.154863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.156095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:57.158811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 16:30:57.181564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 16:30:57.182871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 26 16:30:57.183971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 639/1304] 10.222.0.102 () {56 vars in 1122 bytes} [Thu May 26 16:30:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 16:30:57.193674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:57.274465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:30:57.306307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125b72-0a1d-44b8-9523-3527079842b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:57.347049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:57.347990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.348496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.349022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] PATH_INFO: `/v3/services` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.350315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:30:57.350859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:57.353372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4f01d-8449-4cab-9bef-5de32c788f18 None admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:57.363319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 666/1305] 10.222.0.102 () {56 vars in 1121 bytes} [Thu May 26 16:30:57 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:30:57.369432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:30:57.474103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a6236-a048-4d61-833a-c9018a6f4e7d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:30:57.517000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:30:57.517703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:30:57.517998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:30:57.518208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:30:57.519012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:30:57.520365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823509c0-b2fd-4c9e-b741-d7ef2945d6db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:30:57.540484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 640/1306] 10.222.0.102 () {60 vars in 1149 bytes} [Thu May 26 16:30:57 2022] POST /identity/v3/endpoints => generated 333 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:31:07.356764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=30 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:31:07.535793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:04.859034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13ad-af54-46b6-bb7b-42b57a4b2387 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:04.859926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13ad-af54-46b6-bb7b-42b57a4b2387 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:04.860365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e13ad-af54-46b6-bb7b-42b57a4b2387 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:04.868087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 667/1307] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:04 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:04.869054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622854-33b7-4bed-9b76-f8caca568827 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:04.869439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622854-33b7-4bed-9b76-f8caca568827 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:04.869724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f622854-33b7-4bed-9b76-f8caca568827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:05.043443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f622854-33b7-4bed-9b76-f8caca568827 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:05.045002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f622854-33b7-4bed-9b76-f8caca568827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:05.182863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 641/1308] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:32:05.235330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:05.235874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:05.236313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:05.238732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 668/1309] 10.222.0.102 () {54 vars in 969 bytes} [Thu May 26 16:32:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:05.245275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714997-081d-40a9-8a57-254a8900cf36 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:05.245690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714997-081d-40a9-8a57-254a8900cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:05.246079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6714997-081d-40a9-8a57-254a8900cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:05.332623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a6714997-081d-40a9-8a57-254a8900cf36 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:05.334021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a6714997-081d-40a9-8a57-254a8900cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:05.360922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:05.439592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 642/1310] 10.222.0.102 () {58 vars in 1066 bytes} [Thu May 26 16:32:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:05.451079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:05.454361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:05.596208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1848ba8-07b3-49ab-8768-440faaf67b6f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:05.677967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:05.678543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:05.678828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:05.679107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:05.680832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:05.739605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:05.800272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:05.801831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005f487-a990-4ec0-8ef5-050fe1b56dac service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:05.824032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 669/1311] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:32:08.367443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.367959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.367959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.369382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 643/1312] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:08.374916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f980-1f85-472b-820d-09fe73477fab None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.375373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f980-1f85-472b-820d-09fe73477fab None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.375487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8f980-1f85-472b-820d-09fe73477fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.455049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cdf8f980-1f85-472b-820d-09fe73477fab None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:08.456327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cdf8f980-1f85-472b-820d-09fe73477fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:08.559418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 670/1313] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:08.601571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:08.604354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:08.716042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9557a9b-c8e1-4ae2-8271-cadcf5036e09 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:08.788217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:08.791775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:08.792892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:08.793407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:08.793688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:08.795578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:08.909200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:08.910585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47463c-5070-4f08-b6a6-0f6d93568ed9 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:08.928948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 644/1314] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:11.671952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1f44-3b5e-4e95-b453-b105e1e8e764 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.672511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1f44-3b5e-4e95-b453-b105e1e8e764 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.672610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a1f44-3b5e-4e95-b453-b105e1e8e764 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.673961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 671/1315] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:11.679951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18f2e-2419-49ba-b235-b311f7e92f0e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.680491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18f2e-2419-49ba-b235-b311f7e92f0e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.680634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a18f2e-2419-49ba-b235-b311f7e92f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.751248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-88a18f2e-2419-49ba-b235-b311f7e92f0e None None] MFA Rules not processed for user `615a6306259748a9a80aa390084a98e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:11.752524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-88a18f2e-2419-49ba-b235-b311f7e92f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:11.814715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:11.865889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 645/1316] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:11.935528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.936014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.936534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:11.938968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 672/1317] 10.222.0.102 () {54 vars in 969 bytes} [Thu May 26 16:32:11 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:11.946058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae325d8-8526-4691-944b-8fa845adcde9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:11.946455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae325d8-8526-4691-944b-8fa845adcde9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:11.946746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae325d8-8526-4691-944b-8fa845adcde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.027555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1ae325d8-8526-4691-944b-8fa845adcde9 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:12.028817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1ae325d8-8526-4691-944b-8fa845adcde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:12.105141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 646/1318] 10.222.0.102 () {58 vars in 1066 bytes} [Thu May 26 16:32:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:12.114318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:12.115850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:12.125892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.222746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c6c4a-9de1-4fa1-8c73-005794c7d3af None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:12.313297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:12.314405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:12.314907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:12.315401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:12.318333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:12.393377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:12.442372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:12.443883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4710477-4e1f-4668-bfbc-25c762f2bb15 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:12.463357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 673/1319] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:15.643616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:15.644154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:15.644154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:15.646156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 647/1320] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:15.652089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339a9d-413e-4ff5-a39c-627866d8c97e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:15.652696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339a9d-413e-4ff5-a39c-627866d8c97e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:15.652792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48339a9d-413e-4ff5-a39c-627866d8c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:15.720341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-48339a9d-413e-4ff5-a39c-627866d8c97e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:15.721590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-48339a9d-413e-4ff5-a39c-627866d8c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:15.818128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 674/1321] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:15.857022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:15.858564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:15.908925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:15.964018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c845a8-a162-4221-a058-1c89db2f20d2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:16.036809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:16.037460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:16.037747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:16.038023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:16.039689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:16.137232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:16.150827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:16.152285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4e238b-7b8b-4ceb-af1e-f4af4da2ed37 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:16.170736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 648/1322] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:19.136496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.137047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.137137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.138480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 675/1323] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:19.144214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db3ba-14ae-4cd3-b4db-dc9587832005 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.144760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db3ba-14ae-4cd3-b4db-dc9587832005 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.144862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176db3ba-14ae-4cd3-b4db-dc9587832005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.221354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-176db3ba-14ae-4cd3-b4db-dc9587832005 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:19.222604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-176db3ba-14ae-4cd3-b4db-dc9587832005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:19.340477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 649/1324] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:19.376351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:19.377695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:19.398939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:19.487805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4fb86-7dce-4dfa-b86e-16d4d5558bcd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:19.562486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:19.563133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:19.563419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:19.563697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:19.565386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:19.640104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:19.691736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:19.693129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d108d-5fc4-44f2-aed6-49e2eecd7926 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:19.712516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 676/1325] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:21.991540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.992116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.992116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:21.993680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 650/1326] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:21 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:21.998982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afe20e-68d6-4b97-8009-f1582af3d783 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:21.999395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afe20e-68d6-4b97-8009-f1582af3d783 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:21.999800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afe20e-68d6-4b97-8009-f1582af3d783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:22.067891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c7afe20e-68d6-4b97-8009-f1582af3d783 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:22.069902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c7afe20e-68d6-4b97-8009-f1582af3d783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:22.182760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 677/1327] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:22.219821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:22.221500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:22.284158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:22.333152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36696fa-1e85-48d4-b1c3-e202537c782e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:22.409835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:22.410513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:22.410806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:22.411087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:22.412874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:22.529560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:22.532343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:22.534513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df6ebc-9bb4-43d2-8643-9d95c9ad170b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:22.556333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 651/1328] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:24.876991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.877551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.877551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.879123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 678/1329] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:24.885126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68666-7ade-4f7b-ad2c-a78be152089e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:24.885632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68666-7ade-4f7b-ad2c-a78be152089e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:24.885727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68666-7ade-4f7b-ad2c-a78be152089e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:24.955874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1ff68666-7ade-4f7b-ad2c-a78be152089e None None] MFA Rules not processed for user `615a6306259748a9a80aa390084a98e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:24.957110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1ff68666-7ade-4f7b-ad2c-a78be152089e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:25.074214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 652/1330] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:24 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:25.111334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:25.112899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:25.149707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:25.235337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3990e-9609-41ec-b2aa-428bd29bc80f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:25.320561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:25.321222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:25.321505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:25.321777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:25.323436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:25.413505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:25.447296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:25.448766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910b4dab-9c37-489c-ab2d-82f04196d6fd service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:25.467759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 679/1331] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:28.063677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.064523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.064523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.068562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 653/1332] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:28 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:28.072529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2bd40-d1ce-4167-a5fb-54108d44f386 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.073363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2bd40-d1ce-4167-a5fb-54108d44f386 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.073565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2bd40-d1ce-4167-a5fb-54108d44f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.160822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4de2bd40-d1ce-4167-a5fb-54108d44f386 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:28.162090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4de2bd40-d1ce-4167-a5fb-54108d44f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:28.278628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 680/1333] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:28.339125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:28.340711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:28.419922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:28.461949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c68f5-5c47-41f3-aab2-9677c2fa2342 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:28.542013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:28.542634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:28.542960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:28.543297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:28.545220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:28.720139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:28.723109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97647980-55f0-4667-9dde-99acdc150d73 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:28.743758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:28.763311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 654/1334] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:32:31.315458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:31.315999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:31.315999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:31.317429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 681/1335] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:32:31.324713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3e9e-bf52-4160-ac8b-358a978f4397 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:31.325230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3e9e-bf52-4160-ac8b-358a978f4397 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:31.325676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3e9e-bf52-4160-ac8b-358a978f4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:31.425525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bebd3e9e-bf52-4160-ac8b-358a978f4397 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:31.426847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bebd3e9e-bf52-4160-ac8b-358a978f4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:31.531327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 655/1336] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:31.573172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:31.575154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:31.627496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:31.696057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82046fa1-03cb-4aac-9f0d-ddbbb0105f7d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:31.778012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:31.778807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:31.779200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:31.779574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:31.781411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:31.885527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:31.917956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:31.919751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fb684-2a18-466f-997b-19397871075a service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:31.941082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 682/1337] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:34.778291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.779132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.779132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.780228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 656/1338] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:34.786983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d934f8-272e-4752-a08d-810fda4a0601 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:34.787515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d934f8-272e-4752-a08d-810fda4a0601 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:34.787907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d934f8-272e-4752-a08d-810fda4a0601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:34.863179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-64d934f8-272e-4752-a08d-810fda4a0601 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:34.865022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-64d934f8-272e-4752-a08d-810fda4a0601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:34.968850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 683/1339] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:35.019083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:35.022337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:35.146979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:35.191731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1145ef3-d1b5-4c97-aec9-83452096167c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:35.196257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:35.196971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:35.197258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:35.197553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:35.199532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:35.318196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:35.319685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7a41c-7639-4fa9-9bbd-67bf7024893d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:35.340908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 657/1340] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:40.021598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef967e-0683-453d-acfa-17c29d4f4171 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.022137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef967e-0683-453d-acfa-17c29d4f4171 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.022225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef967e-0683-453d-acfa-17c29d4f4171 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.023573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 684/1341] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:40.029014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3136f-8102-4c70-b316-8042a57233df None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.029464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3136f-8102-4c70-b316-8042a57233df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.029708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3136f-8102-4c70-b316-8042a57233df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.081156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b3b3136f-8102-4c70-b316-8042a57233df None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:40.082313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3b3136f-8102-4c70-b316-8042a57233df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:40.145653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:40.167154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 658/1342] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:40.206254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef967e-0683-453d-acfa-17c29d4f4171 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:40.218638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef967e-0683-453d-acfa-17c29d4f4171 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:40.222213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:40.222863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:40.223152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:40.223458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:40.232786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:40.234238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c2c34-2b26-4a2a-9800-888694493a52 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:40.244454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 685/1343] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:43.149496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325203ec-3a9f-4dfa-9d6a-745007819dbf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:43.150071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325203ec-3a9f-4dfa-9d6a-745007819dbf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:43.150071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325203ec-3a9f-4dfa-9d6a-745007819dbf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:43.152084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 659/1344] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:43 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:43.157859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6aae-35e1-4529-ac49-dafd8df640f3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:43.158376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6aae-35e1-4529-ac49-dafd8df640f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:43.158570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e6aae-35e1-4529-ac49-dafd8df640f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:43.188914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a77e6aae-35e1-4529-ac49-dafd8df640f3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:43.190110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a77e6aae-35e1-4529-ac49-dafd8df640f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:43.198440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 686/1345] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:32:43.234893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325203ec-3a9f-4dfa-9d6a-745007819dbf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:43.245771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325203ec-3a9f-4dfa-9d6a-745007819dbf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:43.249243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:43.249877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:43.250161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:43.250440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:43.260642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:43.262084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d850c86-10de-433d-a9aa-79300d63cbd9 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:43.272398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 660/1346] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:47.664785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4933e0-2441-4ab4-b41f-daf20573e4c5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.665429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4933e0-2441-4ab4-b41f-daf20573e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.665429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4933e0-2441-4ab4-b41f-daf20573e4c5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.666694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 687/1347] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:32:47 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:47.673104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbb49-5f7f-4f1b-b673-0aa081c9ff19 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.673586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbb49-5f7f-4f1b-b673-0aa081c9ff19 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.673864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbb49-5f7f-4f1b-b673-0aa081c9ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.693770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a2acbb49-5f7f-4f1b-b673-0aa081c9ff19 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:47.695006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a2acbb49-5f7f-4f1b-b673-0aa081c9ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:47.703424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 661/1348] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:47.742227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4933e0-2441-4ab4-b41f-daf20573e4c5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:32:47.753346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4933e0-2441-4ab4-b41f-daf20573e4c5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:32:47.756902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:32:47.757546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:47.757828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:47.758112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:47.768807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:32:47.770478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22b47e-ad8a-4ef5-9563-8bc268d9fa02 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:32:47.782462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 688/1349] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:32:53.451555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b13bd-1241-4c81-bf42-bafabea6b1b3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.452824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b13bd-1241-4c81-bf42-bafabea6b1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.453548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b13bd-1241-4c81-bf42-bafabea6b1b3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.455634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 662/1350] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:32:53 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:53.463635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a029-75a8-4aa8-abb5-8de73887ca90 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:53.468087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a029-75a8-4aa8-abb5-8de73887ca90 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:53.468907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1a029-75a8-4aa8-abb5-8de73887ca90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:53.474824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:53.594146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4ef1a029-75a8-4aa8-abb5-8de73887ca90 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:53.595749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ef1a029-75a8-4aa8-abb5-8de73887ca90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:53.708773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 689/1351] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:32:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:32:57.688522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=15 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:32:58.814078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbaff2-6d33-486d-a9a8-e61da38eb1a6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.814732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbaff2-6d33-486d-a9a8-e61da38eb1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.814732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbaff2-6d33-486d-a9a8-e61da38eb1a6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.816181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 663/1352] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:32:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:32:58.821244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9ffa-38d5-4e14-9fb0-db07e94fcdb7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:32:58.821697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9ffa-38d5-4e14-9fb0-db07e94fcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:32:58.821801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9ffa-38d5-4e14-9fb0-db07e94fcdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:32:58.841600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6e0f9ffa-38d5-4e14-9fb0-db07e94fcdb7 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:32:58.843095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6e0f9ffa-38d5-4e14-9fb0-db07e94fcdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:32:58.852688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 690/1353] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:32:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:00.348262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e4d1-8df2-4b7e-bce0-3758f2b2fd18 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:00.348960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e4d1-8df2-4b7e-bce0-3758f2b2fd18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:00.349335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8e4d1-8df2-4b7e-bce0-3758f2b2fd18 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.350933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 664/1354] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:33:00 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:00.356997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69255-cfe8-4980-ad93-68068cd16610 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:00.357579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69255-cfe8-4980-ad93-68068cd16610 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:00.357579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e69255-cfe8-4980-ad93-68068cd16610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:00.378133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c6e69255-cfe8-4980-ad93-68068cd16610 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:00.379465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6e69255-cfe8-4980-ad93-68068cd16610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:00.389363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 691/1355] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:33:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:04.118594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ff73-ec64-4422-b1b0-fe620ff69201 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.119907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ff73-ec64-4422-b1b0-fe620ff69201 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.121243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0075ff73-ec64-4422-b1b0-fe620ff69201 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.128572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 665/1356] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:04 2022] GET /identity => generated 271 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:04.130143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028317e-13ee-42a5-bdb8-6301fa5c35a2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.131236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028317e-13ee-42a5-bdb8-6301fa5c35a2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.131684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028317e-13ee-42a5-bdb8-6301fa5c35a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.155119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5028317e-13ee-42a5-bdb8-6301fa5c35a2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:04.156728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5028317e-13ee-42a5-bdb8-6301fa5c35a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:04.165979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 692/1357] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:04.222995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f8ef-102a-497d-9dbe-34aeb8d9efec None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.223283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f8ef-102a-497d-9dbe-34aeb8d9efec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.223569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f8ef-102a-497d-9dbe-34aeb8d9efec None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.225019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 666/1358] 10.222.0.102 () {54 vars in 966 bytes} [Thu May 26 16:33:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:04.233948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca711f-695d-4829-b884-483d41191ee7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.234645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca711f-695d-4829-b884-483d41191ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.235212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca711f-695d-4829-b884-483d41191ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.293654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d6ca711f-695d-4829-b884-483d41191ee7 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:04.295513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d6ca711f-695d-4829-b884-483d41191ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:04.356139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:04.393492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 693/1359] 10.222.0.102 () {58 vars in 1063 bytes} [Thu May 26 16:33:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:04.403301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f8ef-102a-497d-9dbe-34aeb8d9efec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:04.418207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f8ef-102a-497d-9dbe-34aeb8d9efec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:04.425473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:04.426381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:04.426675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:04.426960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:04.437228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:04.438862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239931de-4c10-4e41-9909-6609b252a260 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:04.449910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 667/1360] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:07.006100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571a38-71f2-4b5b-bccb-e492307d52ca None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.006656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571a38-71f2-4b5b-bccb-e492307d52ca None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.006656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7571a38-71f2-4b5b-bccb-e492307d52ca None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.008033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 694/1361] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:07 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:07.016275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85f62-713c-491b-8df2-3325f6e9fabd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.016849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85f62-713c-491b-8df2-3325f6e9fabd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.016931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e85f62-713c-491b-8df2-3325f6e9fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.036134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e0e85f62-713c-491b-8df2-3325f6e9fabd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:07.037378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e0e85f62-713c-491b-8df2-3325f6e9fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:07.047716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 668/1362] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:07.094856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571a38-71f2-4b5b-bccb-e492307d52ca None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:07.112886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7571a38-71f2-4b5b-bccb-e492307d52ca None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:07.119191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:07.119854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:07.120137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:07.120444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:07.130803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:07.132569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff1354-b94c-4063-9641-14cff987677e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:07.145668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 695/1363] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:09.924299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b47ac-9b74-44c3-b69a-94dd6b172566 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.925155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b47ac-9b74-44c3-b69a-94dd6b172566 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.925343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b47ac-9b74-44c3-b69a-94dd6b172566 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.927589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 669/1364] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:33:09.933911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983b07-311d-4658-9d0e-0b13ecdf582c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:09.934521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983b07-311d-4658-9d0e-0b13ecdf582c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:09.934521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f983b07-311d-4658-9d0e-0b13ecdf582c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:09.954328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8f983b07-311d-4658-9d0e-0b13ecdf582c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:09.955550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8f983b07-311d-4658-9d0e-0b13ecdf582c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:09.963915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 696/1365] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:10.010212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199b9a-5623-47af-bf7c-0737a1bbf3e5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.010590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199b9a-5623-47af-bf7c-0737a1bbf3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.010940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc199b9a-5623-47af-bf7c-0737a1bbf3e5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.012409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 670/1366] 10.222.0.102 () {54 vars in 966 bytes} [Thu May 26 16:33:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:10.019608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3e1-7fa6-4f5d-8595-3cbd6df14ee6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.020109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3e1-7fa6-4f5d-8595-3cbd6df14ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.020614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6f3e1-7fa6-4f5d-8595-3cbd6df14ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.049048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-37c6f3e1-7fa6-4f5d-8595-3cbd6df14ee6 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:10.051023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-37c6f3e1-7fa6-4f5d-8595-3cbd6df14ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:10.067248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 697/1367] 10.222.0.102 () {58 vars in 1063 bytes} [Thu May 26 16:33:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:10.075839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199b9a-5623-47af-bf7c-0737a1bbf3e5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:10.098079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc199b9a-5623-47af-bf7c-0737a1bbf3e5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:10.103786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:10.104300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:10.104621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:10.104903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:10.114222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:10.115821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c0491-a8fd-4373-96cc-70c66ffcb3b7 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:10.126258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 671/1368] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:12.559458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cae62-4e3d-4db7-9c39-f35a8b5a9ecc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.560043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cae62-4e3d-4db7-9c39-f35a8b5a9ecc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.560043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cae62-4e3d-4db7-9c39-f35a8b5a9ecc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.562033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 698/1369] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:12.568069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821db21-8b45-4286-a5d9-ec4c43ed2bcb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.568069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821db21-8b45-4286-a5d9-ec4c43ed2bcb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.568674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821db21-8b45-4286-a5d9-ec4c43ed2bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.589767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9821db21-8b45-4286-a5d9-ec4c43ed2bcb None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:12.591187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9821db21-8b45-4286-a5d9-ec4c43ed2bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:12.599954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 672/1370] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:12.651911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cae62-4e3d-4db7-9c39-f35a8b5a9ecc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:12.672900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cae62-4e3d-4db7-9c39-f35a8b5a9ecc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:12.678836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:12.679502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:12.680238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:12.680618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:12.690083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:12.691858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f3a5b-8602-4018-b85d-656f01918663 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:12.703834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 699/1371] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:13.204483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743a5-e0de-436d-a86e-dd61bf713034 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.205251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743a5-e0de-436d-a86e-dd61bf713034 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.205889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628743a5-e0de-436d-a86e-dd61bf713034 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.208768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 673/1372] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:13 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:13.219057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e14f6-7391-4659-a3cc-f4c6379a5f64 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.219821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e14f6-7391-4659-a3cc-f4c6379a5f64 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.221356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e14f6-7391-4659-a3cc-f4c6379a5f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.251784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fe2e14f6-7391-4659-a3cc-f4c6379a5f64 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:13.254046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fe2e14f6-7391-4659-a3cc-f4c6379a5f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:13.268216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 700/1373] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:13.639840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db1c-650a-4695-ac3a-97bcc6047564 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.640405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db1c-650a-4695-ac3a-97bcc6047564 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.640869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1db1c-650a-4695-ac3a-97bcc6047564 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.642649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 674/1374] 10.222.0.102 () {54 vars in 968 bytes} [Thu May 26 16:33:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:13.649882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533e59-17a4-4fa5-88d9-c6651e043210 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.650456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533e59-17a4-4fa5-88d9-c6651e043210 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.650769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3533e59-17a4-4fa5-88d9-c6651e043210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.714092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a3533e59-17a4-4fa5-88d9-c6651e043210 None None] MFA Rules not processed for user `9dd18deb63da438cb8eee3d8e7daa955`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:13.715613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a3533e59-17a4-4fa5-88d9-c6651e043210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:13.803651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 701/1375] 10.222.0.102 () {58 vars in 1065 bytes} [Thu May 26 16:33:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:13.814107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1db1c-650a-4695-ac3a-97bcc6047564 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:13.827946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1db1c-650a-4695-ac3a-97bcc6047564 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:13.832487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:13.833118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:13.833495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:13.834000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:13.844668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:13.846211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922a2bc-af7d-42ce-a7ec-b2fd4f8b79c5 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:13.857250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 675/1376] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:15.168896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13832-7a9a-4453-a30c-50725805b07e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.169515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13832-7a9a-4453-a30c-50725805b07e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.169515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a13832-7a9a-4453-a30c-50725805b07e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.171792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 702/1377] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:15.178054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edbda-2cb9-4d2b-8153-e7d3e4f168b4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.178614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edbda-2cb9-4d2b-8153-e7d3e4f168b4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.178729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11edbda-2cb9-4d2b-8153-e7d3e4f168b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.200056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f11edbda-2cb9-4d2b-8153-e7d3e4f168b4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:15.201299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f11edbda-2cb9-4d2b-8153-e7d3e4f168b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:15.211518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 676/1378] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:15.257606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13832-7a9a-4453-a30c-50725805b07e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:15.272239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a13832-7a9a-4453-a30c-50725805b07e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:15.278162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:15.278822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:15.279102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:15.279379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:15.289160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:15.290762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc14f5-c6ee-4848-b6b0-faf5da29c6cc service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:15.301703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 703/1379] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:17.674315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b561-032d-48f2-93e5-c23889959e9d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.675196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b561-032d-48f2-93e5-c23889959e9d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.675686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9b561-032d-48f2-93e5-c23889959e9d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.678278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 677/1380] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:17 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:17.688963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597169a8-f100-4281-b455-515aed7f18c3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.689537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597169a8-f100-4281-b455-515aed7f18c3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.689640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597169a8-f100-4281-b455-515aed7f18c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.719542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-597169a8-f100-4281-b455-515aed7f18c3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:17.721444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-597169a8-f100-4281-b455-515aed7f18c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:17.736164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 704/1381] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:17.789436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b561-032d-48f2-93e5-c23889959e9d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:17.809328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9b561-032d-48f2-93e5-c23889959e9d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:17.815273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:17.815868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:17.816151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:17.816654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:17.829062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:17.831217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eb639-e002-420b-9c12-7d4cc8bae7ed service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:17.847968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 678/1382] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:20.203706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00a74-6a9f-41e2-a160-85b3b6c4b25e None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.204629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00a74-6a9f-41e2-a160-85b3b6c4b25e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.204910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00a74-6a9f-41e2-a160-85b3b6c4b25e None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.206440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 705/1383] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:20.213094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbc57-75e7-48cc-8c44-804259b21f0a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.214038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbc57-75e7-48cc-8c44-804259b21f0a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.214535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edbc57-75e7-48cc-8c44-804259b21f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.235840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-25edbc57-75e7-48cc-8c44-804259b21f0a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:20.238359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-25edbc57-75e7-48cc-8c44-804259b21f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:20.253347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 679/1384] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:20.305565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00a74-6a9f-41e2-a160-85b3b6c4b25e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:20.346201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00a74-6a9f-41e2-a160-85b3b6c4b25e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:20.354288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:20.355121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:20.355378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:20.355864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:20.370321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:20.373304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ddf6ed-5a0e-4aff-be8f-8bacda140e18 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:20.394210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 706/1385] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:22.775089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a20-93b1-4639-bdf7-17143c1d4242 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.776214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a20-93b1-4639-bdf7-17143c1d4242 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.776214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f6a20-93b1-4639-bdf7-17143c1d4242 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.777700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 680/1386] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:22 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:22.783781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1274a3-e2a8-4c27-abf5-44c7091e025e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.784985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1274a3-e2a8-4c27-abf5-44c7091e025e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.784985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1274a3-e2a8-4c27-abf5-44c7091e025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.803940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cf1274a3-e2a8-4c27-abf5-44c7091e025e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:22.805264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cf1274a3-e2a8-4c27-abf5-44c7091e025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:22.823822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 707/1387] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:22.871561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6a20-93b1-4639-bdf7-17143c1d4242 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:22.889033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f6a20-93b1-4639-bdf7-17143c1d4242 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:22.895839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:22.896922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:22.897257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:22.897638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:22.908318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:22.909993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc270769-114d-46e5-9d0f-0f8f0ddcc62f service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:22.921905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 681/1388] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:33:25.455454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2de7-060e-4b6f-a0d7-5baa35833081 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.456550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2de7-060e-4b6f-a0d7-5baa35833081 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.456550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2de7-060e-4b6f-a0d7-5baa35833081 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.457712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 708/1389] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:25 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:25.465674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad1d4-e189-4603-9fff-80a4276520ae None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.466303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad1d4-e189-4603-9fff-80a4276520ae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.466436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ad1d4-e189-4603-9fff-80a4276520ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.494888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3c4ad1d4-e189-4603-9fff-80a4276520ae None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:25.496193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c4ad1d4-e189-4603-9fff-80a4276520ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:25.506063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 682/1390] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:25.564537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2de7-060e-4b6f-a0d7-5baa35833081 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:25.590441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2de7-060e-4b6f-a0d7-5baa35833081 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:25.603086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:25.603985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:25.604350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:25.604724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:25.617513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:25.619966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6fc59-82aa-4005-83cc-7f082536a788 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:25.636140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 709/1391] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:33:28.050038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b71a-af91-4a61-ae7b-40033ca5777b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.051207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b71a-af91-4a61-ae7b-40033ca5777b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.051760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b71a-af91-4a61-ae7b-40033ca5777b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.055962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 683/1392] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:28 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:28.063012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987961-d439-4089-9d9d-68ec8d5af0b4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.063615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987961-d439-4089-9d9d-68ec8d5af0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.064009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6987961-d439-4089-9d9d-68ec8d5af0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.090241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f6987961-d439-4089-9d9d-68ec8d5af0b4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:28.092718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f6987961-d439-4089-9d9d-68ec8d5af0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:28.106223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 710/1393] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:28.177038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b71a-af91-4a61-ae7b-40033ca5777b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:28.191507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=46 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:28.204857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b71a-af91-4a61-ae7b-40033ca5777b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:28.216251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:28.217670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:28.218298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:28.219118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:28.237716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:28.240485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86635d51-0009-4c8d-9ddb-636be009cbc9 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:28.257050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 684/1394] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:30.554915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936774-eac9-4a1b-b8b8-7d40302b4386 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.555518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936774-eac9-4a1b-b8b8-7d40302b4386 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.555518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31936774-eac9-4a1b-b8b8-7d40302b4386 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.557433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 711/1395] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:30 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:30.564207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81b2f-1169-4532-a4e8-04709c9a6911 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.564797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81b2f-1169-4532-a4e8-04709c9a6911 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.564797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d81b2f-1169-4532-a4e8-04709c9a6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.583468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-33d81b2f-1169-4532-a4e8-04709c9a6911 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:30.584702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33d81b2f-1169-4532-a4e8-04709c9a6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:30.592729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 685/1396] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:30.651610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56ee0-610b-4d01-afec-f02486c89109 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.651937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56ee0-610b-4d01-afec-f02486c89109 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.652164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b56ee0-610b-4d01-afec-f02486c89109 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.653651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 712/1397] 10.222.0.102 () {54 vars in 967 bytes} [Thu May 26 16:33:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:30.659433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad9bb-540e-43d0-ba70-e96b40fae15f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.659884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad9bb-540e-43d0-ba70-e96b40fae15f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.660215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dad9bb-540e-43d0-ba70-e96b40fae15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.661777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358870b7-b445-482b-ba2b-b0ff9cb176e5 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.662075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358870b7-b445-482b-ba2b-b0ff9cb176e5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.662394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358870b7-b445-482b-ba2b-b0ff9cb176e5 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.663860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 713/1398] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:30.669875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.670187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.670440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.691934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:30.693187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:30.701857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 714/1399] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:30.722653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d1dad9bb-540e-43d0-ba70-e96b40fae15f None None] MFA Rules not processed for user `9ec344b4ce9a4de4b55b6425b75da380`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:30.723890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d1dad9bb-540e-43d0-ba70-e96b40fae15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:30.747700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.756281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:30.761565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423d727-132d-424d-869f-b6e4831c16b5 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.767377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.768034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.768323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.768632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.777706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.779373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.790024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 715/1401] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:33:30.790249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 686/1401] 10.222.0.102 () {58 vars in 1064 bytes} [Thu May 26 16:33:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:30.799297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:30.809680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82065fe9-08ea-4820-988b-19c9fdb9da59 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:30.813660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:30.814383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:30.814602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:30.814886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:30.826954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:30.828490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac158b6c-3746-482b-acb3-58f700263793 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:30.840311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 716/1402] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:31.413898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77a2a-629f-4428-9b3d-8218944a7f2e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.414191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77a2a-629f-4428-9b3d-8218944a7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.414470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b77a2a-629f-4428-9b3d-8218944a7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.464739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a7b77a2a-629f-4428-9b3d-8218944a7f2e None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:31.465938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7b77a2a-629f-4428-9b3d-8218944a7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:31.540171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 687/1403] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:31.590529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb834b-2516-4e16-a87a-fc65bb98a7f3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.591159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb834b-2516-4e16-a87a-fc65bb98a7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.591159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb834b-2516-4e16-a87a-fc65bb98a7f3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.592638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 717/1404] 10.222.0.102 () {54 vars in 947 bytes} [Thu May 26 16:33:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:31.600405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3b5b-007e-4983-9978-e05e60fb205c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.601122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3b5b-007e-4983-9978-e05e60fb205c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.601122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3b5b-007e-4983-9978-e05e60fb205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.648737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:31.652430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4d8e3b5b-007e-4983-9978-e05e60fb205c None None] MFA Rules not processed for user `34368002fec64283a184b548b246f345`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:31.654047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d8e3b5b-007e-4983-9978-e05e60fb205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:31.729745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 688/1405] 10.222.0.102 () {58 vars in 1044 bytes} [Thu May 26 16:33:31 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:33:31.739609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb834b-2516-4e16-a87a-fc65bb98a7f3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:31.753250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb834b-2516-4e16-a87a-fc65bb98a7f3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:31.758235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:31.758879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:31.759169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:31.759437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:31.767941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:31.769585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351a8ea-887f-4f51-ab6b-b6ba9a36bad4 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:31.778143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 718/1406] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:33:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:33:33.385347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67d36-a9fc-49ea-9725-687ce105c8c8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.386331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67d36-a9fc-49ea-9725-687ce105c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.386331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd67d36-a9fc-49ea-9725-687ce105c8c8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.392566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 689/1407] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:33:33 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:33.397819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02877f-37e4-4257-a9bc-03670f7fe99c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.398376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02877f-37e4-4257-a9bc-03670f7fe99c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.398376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02877f-37e4-4257-a9bc-03670f7fe99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.423812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5f02877f-37e4-4257-a9bc-03670f7fe99c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:33.425065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5f02877f-37e4-4257-a9bc-03670f7fe99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:33.435949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 719/1408] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:33.486005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67d36-a9fc-49ea-9725-687ce105c8c8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:33.521122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd67d36-a9fc-49ea-9725-687ce105c8c8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:33.535478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:33.536148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:33.536474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:33.536770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:33.552537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:33.558004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c5a04-016f-40b4-9847-37c5b4bbc07d service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:33.572325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 690/1409] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:43.416447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=19 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:43.565591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=36 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:33:55.923614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9994-c7ba-4dc9-b80a-1df0c7d6a1f8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.924246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9994-c7ba-4dc9-b80a-1df0c7d6a1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.924246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc9994-c7ba-4dc9-b80a-1df0c7d6a1f8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.925723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 720/1410] 10.222.0.102 () {54 vars in 923 bytes} [Thu May 26 16:33:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:55.931518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e64cb-da22-4f9d-9b57-e2b64ed0746c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.932049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e64cb-da22-4f9d-9b57-e2b64ed0746c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.932151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e64cb-da22-4f9d-9b57-e2b64ed0746c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.951872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac8e64cb-da22-4f9d-9b57-e2b64ed0746c None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:55.953255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac8e64cb-da22-4f9d-9b57-e2b64ed0746c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:55.964327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 691/1411] 10.222.0.102 () {58 vars in 1020 bytes} [Thu May 26 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:55.979774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e458c-c19c-4799-8200-6ea68fb6e018 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.980071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e458c-c19c-4799-8200-6ea68fb6e018 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.980358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e458c-c19c-4799-8200-6ea68fb6e018 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:55.982030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 721/1412] 10.222.0.102 () {54 vars in 923 bytes} [Thu May 26 16:33:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:55.987229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bf53-f4fc-4c8d-8ea2-634d7b02557f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:55.987507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bf53-f4fc-4c8d-8ea2-634d7b02557f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:55.987802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3bf53-f4fc-4c8d-8ea2-634d7b02557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:56.007956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ca3bf53-f4fc-4c8d-8ea2-634d7b02557f None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:56.009240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ca3bf53-f4fc-4c8d-8ea2-634d7b02557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:56.019840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 692/1413] 10.222.0.102 () {58 vars in 1020 bytes} [Thu May 26 16:33:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:58.836933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304b68-9be7-4b48-a6f0-24fafe3158bc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.837605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304b68-9be7-4b48-a6f0-24fafe3158bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.837605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c304b68-9be7-4b48-a6f0-24fafe3158bc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.839004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:33:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:58.844821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8405c7-f793-462b-b1ad-05983bd67ca1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.845330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8405c7-f793-462b-b1ad-05983bd67ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.845497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8405c7-f793-462b-b1ad-05983bd67ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.864961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fb8405c7-f793-462b-b1ad-05983bd67ca1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:58.866179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fb8405c7-f793-462b-b1ad-05983bd67ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:58.874242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:33:58.917657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304b68-9be7-4b48-a6f0-24fafe3158bc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:33:58.933320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c304b68-9be7-4b48-a6f0-24fafe3158bc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:33:58.939221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:33:58.939938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:58.940220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:58.940542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:58.949401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:33:58.951012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741b3ce-aacb-4ea0-93f1-98f182db076d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:33:58.960954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 723/1416] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:33:59.950011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f197d-e21b-4bcd-ae0e-07a5ae81785a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.950598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f197d-e21b-4bcd-ae0e-07a5ae81785a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.950598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f197d-e21b-4bcd-ae0e-07a5ae81785a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.951949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:33:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:33:59.957168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad2b7-b922-45a8-9907-d13258babe03 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:33:59.957682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad2b7-b922-45a8-9907-d13258babe03 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:33:59.957786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaad2b7-b922-45a8-9907-d13258babe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:33:59.975488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2eaad2b7-b922-45a8-9907-d13258babe03 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:33:59.976713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2eaad2b7-b922-45a8-9907-d13258babe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:33:59.984473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:00.140717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f197d-e21b-4bcd-ae0e-07a5ae81785a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:00.156960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f197d-e21b-4bcd-ae0e-07a5ae81785a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:00.162496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:00.163144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:00.163433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:00.163715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:00.172947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:00.174571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb093961-55b2-41bf-830a-f5b395a524ec service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:00.184777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 695/1419] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:01.138246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379ea6-3439-4762-991a-ec0e0617d821 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.138924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379ea6-3439-4762-991a-ec0e0617d821 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.138924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7379ea6-3439-4762-991a-ec0e0617d821 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.140177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:01.146725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4838-4504-4c5c-b507-a6d083083e47 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.147522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4838-4504-4c5c-b507-a6d083083e47 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.147522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c4838-4504-4c5c-b507-a6d083083e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.166731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c53c4838-4504-4c5c-b507-a6d083083e47 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:01.167955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c53c4838-4504-4c5c-b507-a6d083083e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:01.175997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:01.328882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7379ea6-3439-4762-991a-ec0e0617d821 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:01.343448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7379ea6-3439-4762-991a-ec0e0617d821 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:01.348850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:01.349496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:01.349786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:01.350064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:01.358823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:01.360565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1baa3-d45a-4045-acdf-5fad800529cd service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:01.372084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 726/1422] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:02.306931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb4f9-8326-4195-9760-b8d95e34fc29 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.307855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb4f9-8326-4195-9760-b8d95e34fc29 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.307855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb4f9-8326-4195-9760-b8d95e34fc29 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.309642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:02 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:02.317472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cedc7-f709-44e4-b754-c9f381ad2faf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.317999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cedc7-f709-44e4-b754-c9f381ad2faf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.318404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cedc7-f709-44e4-b754-c9f381ad2faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.337635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-523cedc7-f709-44e4-b754-c9f381ad2faf None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:02.338843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-523cedc7-f709-44e4-b754-c9f381ad2faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:02.347563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:02.509759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb4f9-8326-4195-9760-b8d95e34fc29 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:02.526368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb4f9-8326-4195-9760-b8d95e34fc29 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:02.532250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:02.533093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:02.533407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:02.533688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:02.543066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:02.544764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ace6-1385-43fa-8ee7-9fb61dd9b26e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:02.555218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 698/1425] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:03.510473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57f82-21da-4f0c-b536-5c17475079fc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.511076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57f82-21da-4f0c-b536-5c17475079fc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.511076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c57f82-21da-4f0c-b536-5c17475079fc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.513179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:03.520086 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b49cf-b24e-49ef-b4c8-d7a84d0d169c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.520682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b49cf-b24e-49ef-b4c8-d7a84d0d169c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.520810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b49cf-b24e-49ef-b4c8-d7a84d0d169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.543661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-353b49cf-b24e-49ef-b4c8-d7a84d0d169c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:03.544944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-353b49cf-b24e-49ef-b4c8-d7a84d0d169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:03.553394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:03.709474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c57f82-21da-4f0c-b536-5c17475079fc None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:03.731984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c57f82-21da-4f0c-b536-5c17475079fc None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:03.740461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:03.741156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:03.741429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:03.741735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:03.756483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:03.759298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac28078a-0ff4-4c0a-ba14-7105215e133d service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:03.776700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 729/1428] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:04.706782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb896c-4ded-4a19-9b32-0a5e20fb107f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.707384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb896c-4ded-4a19-9b32-0a5e20fb107f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.707384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb896c-4ded-4a19-9b32-0a5e20fb107f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.708751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:04 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:04.713831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4626-cc18-47a9-ad8e-58e86cbe9626 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.714286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4626-cc18-47a9-ad8e-58e86cbe9626 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.714399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f4626-cc18-47a9-ad8e-58e86cbe9626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.733582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a58f4626-cc18-47a9-ad8e-58e86cbe9626 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:04.734813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a58f4626-cc18-47a9-ad8e-58e86cbe9626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:04.744791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:04.898478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb896c-4ded-4a19-9b32-0a5e20fb107f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:04.912770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb896c-4ded-4a19-9b32-0a5e20fb107f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:04.919370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:04.920021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:04.920337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:04.920640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:04.929546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:04.931360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a84211-a946-4237-abfe-68de10a73243 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:04.942247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 701/1431] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:05.803592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638a514-5acf-47ba-be58-927305b284eb None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.804198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638a514-5acf-47ba-be58-927305b284eb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.804338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638a514-5acf-47ba-be58-927305b284eb None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.806320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:34:05.811814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df7b7-2d95-4036-b8c2-8e439796fa9d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:05.812307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df7b7-2d95-4036-b8c2-8e439796fa9d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:05.812453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df7b7-2d95-4036-b8c2-8e439796fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:05.832522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c35df7b7-2d95-4036-b8c2-8e439796fa9d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:05.833732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c35df7b7-2d95-4036-b8c2-8e439796fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:05.844748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:05.998379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638a514-5acf-47ba-be58-927305b284eb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:06.013697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638a514-5acf-47ba-be58-927305b284eb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:06.019143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:06.019796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.020086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.020384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.029677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:06.031277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee1896-64e5-4f28-8dc4-348ecd264483 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:06.040918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 732/1434] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:06.909787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34081-59a7-4609-a749-2f0dfa245adc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.910353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34081-59a7-4609-a749-2f0dfa245adc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.910353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df34081-59a7-4609-a749-2f0dfa245adc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.911768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:06.917777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c3fe-a24f-4d2b-8e43-2d7bce38dc6c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:06.918279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c3fe-a24f-4d2b-8e43-2d7bce38dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:06.918445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55c3fe-a24f-4d2b-8e43-2d7bce38dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:06.937503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5e55c3fe-a24f-4d2b-8e43-2d7bce38dc6c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:06.938759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5e55c3fe-a24f-4d2b-8e43-2d7bce38dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:06.947360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:07.124975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df34081-59a7-4609-a749-2f0dfa245adc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:07.140515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df34081-59a7-4609-a749-2f0dfa245adc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:07.146895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:07.147541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:07.147826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:07.148116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:07.157292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:07.159033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb76d7-adb5-4225-a0b7-fa409a349361 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:07.169178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 704/1437] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:08.046262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ee8d-8cbd-464b-9d03-88ea3bda52b7 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.046954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ee8d-8cbd-464b-9d03-88ea3bda52b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.046954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58ee8d-8cbd-464b-9d03-88ea3bda52b7 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.048188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:34:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:08.053469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239ba3-699c-467a-8e1a-d2b4c0ff152f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.053940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239ba3-699c-467a-8e1a-d2b4c0ff152f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.054043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b239ba3-699c-467a-8e1a-d2b4c0ff152f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.076884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6b239ba3-699c-467a-8e1a-d2b4c0ff152f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:08.079058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b239ba3-699c-467a-8e1a-d2b4c0ff152f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:08.093653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:34:08.245743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58ee8d-8cbd-464b-9d03-88ea3bda52b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:08.259984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58ee8d-8cbd-464b-9d03-88ea3bda52b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:08.265428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:08.266073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:08.266360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:08.266641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:08.277937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:08.280113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e20e1-db4d-4ae0-9785-b068681410c4 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:08.290796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 735/1440] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:10.415636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.416330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.416330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.417762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:10.423557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc80c-55d6-4076-bb65-408e3081192f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.424030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc80c-55d6-4076-bb65-408e3081192f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.424143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc80c-55d6-4076-bb65-408e3081192f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.446207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-299fc80c-55d6-4076-bb65-408e3081192f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:10.447621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-299fc80c-55d6-4076-bb65-408e3081192f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:10.455435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:10.493769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:10.495537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:10.509419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6ca5c-e5e4-44ea-954f-f865af5e4e02 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:10.513180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:10.513828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:10.514114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:10.514396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:10.526635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:10.528106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc830c8b-5320-4fea-9e0e-511ae694c50d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:10.538217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 707/1443] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:12.954093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44dcf-0433-4165-838a-099a5f6b52e9 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.954633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44dcf-0433-4165-838a-099a5f6b52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.954751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e44dcf-0433-4165-838a-099a5f6b52e9 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.956036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:12.961505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449229a-5363-4b6c-9d7b-bf520f0f1a60 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:12.961955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449229a-5363-4b6c-9d7b-bf520f0f1a60 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:12.962054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449229a-5363-4b6c-9d7b-bf520f0f1a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:12.980939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3449229a-5363-4b6c-9d7b-bf520f0f1a60 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:12.982058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3449229a-5363-4b6c-9d7b-bf520f0f1a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:12.990529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:13.027789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44dcf-0433-4165-838a-099a5f6b52e9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:13.039511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e44dcf-0433-4165-838a-099a5f6b52e9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:13.043130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:13.043783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:13.044061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:13.044340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:13.054505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:13.055933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b109ce-6e8f-4cf5-b61d-5c2d71ebeeaf service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:13.065732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 738/1446] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:15.709321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8943a4f-84cd-4ecf-b321-15d9cd1deb0a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.709903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8943a4f-84cd-4ecf-b321-15d9cd1deb0a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.709903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8943a4f-84cd-4ecf-b321-15d9cd1deb0a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.711183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:15 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:15.717901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84567c59-3816-42c1-ae08-d178787c98c7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.718433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84567c59-3816-42c1-ae08-d178787c98c7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.718952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84567c59-3816-42c1-ae08-d178787c98c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.749977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-84567c59-3816-42c1-ae08-d178787c98c7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:15.752118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-84567c59-3816-42c1-ae08-d178787c98c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:15.764440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:15.803234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8943a4f-84cd-4ecf-b321-15d9cd1deb0a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:15.814714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8943a4f-84cd-4ecf-b321-15d9cd1deb0a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:15.818834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:15.819473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:15.819761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:15.820044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:15.829680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:15.831460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312da26-813f-4754-97e4-6f78562eac7c service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:15.848140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 710/1449] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:18.217930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c81c-78a8-4b76-8d7e-2a9cb736bd13 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.218505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c81c-78a8-4b76-8d7e-2a9cb736bd13 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.218505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c81c-78a8-4b76-8d7e-2a9cb736bd13 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.219862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:18.225877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380241-1526-4919-913f-61689466fe36 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.226322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380241-1526-4919-913f-61689466fe36 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.226450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74380241-1526-4919-913f-61689466fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.245512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-74380241-1526-4919-913f-61689466fe36 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:18.246722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-74380241-1526-4919-913f-61689466fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:18.254727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:18.294167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c81c-78a8-4b76-8d7e-2a9cb736bd13 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:18.305579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c81c-78a8-4b76-8d7e-2a9cb736bd13 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:18.309230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:18.309892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:18.310249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:18.310468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:18.320697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:18.322168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c081b44-e0d4-4d91-80eb-570d14c9a57d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:18.332883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 741/1452] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:20.701011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623b72e-271e-4433-8510-c128dcf79d5a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.701554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623b72e-271e-4433-8510-c128dcf79d5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.701554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623b72e-271e-4433-8510-c128dcf79d5a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.702868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:20.709018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5da0b-18f4-4c7d-8c04-2c3588e66c47 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.709488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5da0b-18f4-4c7d-8c04-2c3588e66c47 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.709595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5da0b-18f4-4c7d-8c04-2c3588e66c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.727311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-14a5da0b-18f4-4c7d-8c04-2c3588e66c47 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:20.728734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-14a5da0b-18f4-4c7d-8c04-2c3588e66c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:20.737619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:20.778031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623b72e-271e-4433-8510-c128dcf79d5a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:20.788846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623b72e-271e-4433-8510-c128dcf79d5a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:20.792509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:20.793154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:20.793505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:20.793721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:20.803895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:20.805401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ed41e-d60a-42bc-b96b-ad495cff5397 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:20.817090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 713/1455] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:23.100566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2258-85f8-494b-b2cb-676911ddc722 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.101127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2258-85f8-494b-b2cb-676911ddc722 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.101127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2258-85f8-494b-b2cb-676911ddc722 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.102548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:23.108188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19266-dd5c-4004-847f-8557dab21fbc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.108699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19266-dd5c-4004-847f-8557dab21fbc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.108801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec19266-dd5c-4004-847f-8557dab21fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.126190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2ec19266-dd5c-4004-847f-8557dab21fbc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:23.127383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2ec19266-dd5c-4004-847f-8557dab21fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:23.135182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:23.173462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2258-85f8-494b-b2cb-676911ddc722 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:23.184444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2258-85f8-494b-b2cb-676911ddc722 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:23.188343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:23.189049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:23.189339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:23.189620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:23.198945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:23.200389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe42d9-bfc0-48df-bf8e-d60c459c06fe service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:23.210955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 744/1458] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:25.541930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217568c-d980-48ac-a21a-c5216f296a90 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.542506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217568c-d980-48ac-a21a-c5216f296a90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.542506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217568c-d980-48ac-a21a-c5216f296a90 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.543935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:25.549680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b010c4-85e6-4bf8-b8dc-fa227506934c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.550214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b010c4-85e6-4bf8-b8dc-fa227506934c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.550432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b010c4-85e6-4bf8-b8dc-fa227506934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.556457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=70 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:25.570904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-41b010c4-85e6-4bf8-b8dc-fa227506934c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:25.572045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-41b010c4-85e6-4bf8-b8dc-fa227506934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:25.580334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:25.619405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217568c-d980-48ac-a21a-c5216f296a90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:25.625051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=73 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:25.632682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217568c-d980-48ac-a21a-c5216f296a90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:25.636438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:25.637120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:25.638414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:25.638708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:25.649234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:25.650691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c93acf-2e3d-45b9-bfe0-878fc9b89929 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:25.660490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 716/1461] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:27.961783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba710c-2ff4-48b4-b29f-ec5f36763465 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.962361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba710c-2ff4-48b4-b29f-ec5f36763465 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.962361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba710c-2ff4-48b4-b29f-ec5f36763465 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.963730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:27.968983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796e6c-fa43-4f65-9061-ff90908fab8e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:27.969414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796e6c-fa43-4f65-9061-ff90908fab8e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:27.969547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796e6c-fa43-4f65-9061-ff90908fab8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:27.988779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ee796e6c-fa43-4f65-9061-ff90908fab8e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:27.989973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee796e6c-fa43-4f65-9061-ff90908fab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:27.997874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:28.035363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba710c-2ff4-48b4-b29f-ec5f36763465 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:28.046214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba710c-2ff4-48b4-b29f-ec5f36763465 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:28.049694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:28.050922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:28.051204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:28.051478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:28.060896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:28.062634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328b4680-ce5e-40c1-b0a9-6b784a93af97 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:28.073225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 747/1464] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:30.306878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315538b7-c05c-45ea-9bbd-32a3e38f75dd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.307626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315538b7-c05c-45ea-9bbd-32a3e38f75dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.307626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315538b7-c05c-45ea-9bbd-32a3e38f75dd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.308969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:30 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:30.316191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950260e-e07a-4f22-9282-4b3ec383927b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.316672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950260e-e07a-4f22-9282-4b3ec383927b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.316888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950260e-e07a-4f22-9282-4b3ec383927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.336355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f950260e-e07a-4f22-9282-4b3ec383927b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:30.337577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f950260e-e07a-4f22-9282-4b3ec383927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:30.346377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:30.382942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315538b7-c05c-45ea-9bbd-32a3e38f75dd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:30.394530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315538b7-c05c-45ea-9bbd-32a3e38f75dd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:30.398324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:30.398959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:30.399240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:30.399515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:30.409020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:30.410455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b196a-d388-4a65-b1c3-74822c65e423 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:30.420238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 719/1467] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:34:32.690508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443c18-4640-4e0f-84dd-bf7e6dcdb5b8 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.691550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443c18-4640-4e0f-84dd-bf7e6dcdb5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.691550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be443c18-4640-4e0f-84dd-bf7e6dcdb5b8 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.692940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:34:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:34:32.698489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0864ca2-8f65-4c86-bb97-1b1266c591e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.698940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0864ca2-8f65-4c86-bb97-1b1266c591e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.699075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0864ca2-8f65-4c86-bb97-1b1266c591e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.717797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d0864ca2-8f65-4c86-bb97-1b1266c591e3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:34:32.718405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0864ca2-8f65-4c86-bb97-1b1266c591e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:34:32.726332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:34:32.762788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be443c18-4640-4e0f-84dd-bf7e6dcdb5b8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:34:32.774449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be443c18-4640-4e0f-84dd-bf7e6dcdb5b8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:34:32.778001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:34:32.778640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:34:32.778928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:34:32.779208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:34:32.788253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:34:32.789737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d920c-a12d-4d8f-baac-e92180120831 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:34:32.799485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 750/1470] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:34:42.712331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=17 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:34:42.795093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=17 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:06.245767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b784ad-0fef-418a-96ff-1237d6e78c0f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:06.246365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b784ad-0fef-418a-96ff-1237d6e78c0f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:06.246365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b784ad-0fef-418a-96ff-1237d6e78c0f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:06.247713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 721/1471] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:06.252889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ed5d-79d7-4d25-95f2-225f59d46957 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:06.253356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ed5d-79d7-4d25-95f2-225f59d46957 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:06.253484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ed5d-79d7-4d25-95f2-225f59d46957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:06.272534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-45a3ed5d-79d7-4d25-95f2-225f59d46957 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:06.273732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45a3ed5d-79d7-4d25-95f2-225f59d46957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:06.281417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 751/1472] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:06.328885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905938f9-26df-441a-88e7-63e0f1a355c1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:06.329183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905938f9-26df-441a-88e7-63e0f1a355c1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:06.329471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905938f9-26df-441a-88e7-63e0f1a355c1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:06.330841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 722/1473] 10.222.0.102 () {54 vars in 967 bytes} [Thu May 26 16:35:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:06.336164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e945-0d85-44ea-b6f8-1489f5cc47ae None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:06.336483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e945-0d85-44ea-b6f8-1489f5cc47ae None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:06.336827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e945-0d85-44ea-b6f8-1489f5cc47ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:06.355411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1ac2e945-0d85-44ea-b6f8-1489f5cc47ae None None] MFA Rules not processed for user `9ec344b4ce9a4de4b55b6425b75da380`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:06.356620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1ac2e945-0d85-44ea-b6f8-1489f5cc47ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:06.363271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 752/1474] 10.222.0.102 () {58 vars in 1064 bytes} [Thu May 26 16:35:06 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:06.370300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905938f9-26df-441a-88e7-63e0f1a355c1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:06.381230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905938f9-26df-441a-88e7-63e0f1a355c1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:06.388486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:06.389134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:06.389427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:06.389701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:06.400104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:06.401616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4e08d-846b-44e5-ba37-8f088a388801 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:06.411786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 723/1475] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:08.730370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdba2-1274-443c-aa83-49952e3eaa6a None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.730920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdba2-1274-443c-aa83-49952e3eaa6a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.730920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fdba2-1274-443c-aa83-49952e3eaa6a None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.732279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 753/1476] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:08 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:08.738067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fafaa9-071d-4b36-a220-f3cbbfa25d6d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.739151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fafaa9-071d-4b36-a220-f3cbbfa25d6d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.739151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fafaa9-071d-4b36-a220-f3cbbfa25d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.756950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-64fafaa9-071d-4b36-a220-f3cbbfa25d6d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:08.757839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64fafaa9-071d-4b36-a220-f3cbbfa25d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:08.765562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 724/1477] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:08.789859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fdba2-1274-443c-aa83-49952e3eaa6a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:08.802538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fdba2-1274-443c-aa83-49952e3eaa6a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:08.807262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:08.807937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:08.808223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:08.808540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:08.809282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:08.811087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:35:08.811087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:35:08.811087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:35:08.812248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351730f-d557-40c0-8a9b-acd41d4c3cb1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:08.831718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 754/1478] 10.222.0.102 () {56 vars in 1113 bytes} [Thu May 26 16:35:08 2022] GET /identity/v3/projects => generated 2562 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:35:11.045467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a41-75f0-45bd-acc9-03583262e393 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.046001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a41-75f0-45bd-acc9-03583262e393 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.046001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4a41-75f0-45bd-acc9-03583262e393 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.047348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 725/1479] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:11 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:11.052703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97b63-5f97-4a79-93d4-e67ef9a2432f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.053155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97b63-5f97-4a79-93d4-e67ef9a2432f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.053253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a97b63-5f97-4a79-93d4-e67ef9a2432f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.071060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-97a97b63-5f97-4a79-93d4-e67ef9a2432f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:11.072250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-97a97b63-5f97-4a79-93d4-e67ef9a2432f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:11.080068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 755/1480] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:11.124158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4a41-75f0-45bd-acc9-03583262e393 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:11.138230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4a41-75f0-45bd-acc9-03583262e393 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:11.143524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:11.144153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:11.144966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:11.145261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:11.153517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:11.155108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247237c9-6fb9-4f3f-842a-cb3f1cf725dc service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:11.165273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 726/1481] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:13.652085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3153e-1046-4153-afa8-c35bd75dba21 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.652625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3153e-1046-4153-afa8-c35bd75dba21 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.652625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3153e-1046-4153-afa8-c35bd75dba21 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.653990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 756/1482] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:13.659455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cfee-2860-4271-b859-111a51bccc12 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.660443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cfee-2860-4271-b859-111a51bccc12 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.660557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cfee-2860-4271-b859-111a51bccc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.678563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dac7cfee-2860-4271-b859-111a51bccc12 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:13.679757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dac7cfee-2860-4271-b859-111a51bccc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:13.687694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 727/1483] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:13.724319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3153e-1046-4153-afa8-c35bd75dba21 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:13.734971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3153e-1046-4153-afa8-c35bd75dba21 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:13.738651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:13.739521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:13.739807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:13.740083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:13.749585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:13.751036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa57d63-2e27-4cdf-b1d1-37a625b61237 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:13.760989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 757/1484] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:16.061565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9adc3c-8187-4643-b73d-ff1416e18a76 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.062421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9adc3c-8187-4643-b73d-ff1416e18a76 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.062583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9adc3c-8187-4643-b73d-ff1416e18a76 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.064382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 728/1485] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:16.070530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9a9d-2b69-4088-9c6e-6a3d15048f82 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.071002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9a9d-2b69-4088-9c6e-6a3d15048f82 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.071103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b9a9d-2b69-4088-9c6e-6a3d15048f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.089436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ca7b9a9d-2b69-4088-9c6e-6a3d15048f82 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:16.090641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ca7b9a9d-2b69-4088-9c6e-6a3d15048f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:16.099256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 758/1486] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:16.136960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9adc3c-8187-4643-b73d-ff1416e18a76 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:16.148693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9adc3c-8187-4643-b73d-ff1416e18a76 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:16.153012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:16.153667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:16.153956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:16.154236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:16.163960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:16.165464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cef5-887f-48dc-b5c8-9a165c8b30ff service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:16.175119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 729/1487] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:18.561139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96046e9-7c23-4082-a2eb-68cd0d0a4f72 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.561744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96046e9-7c23-4082-a2eb-68cd0d0a4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.561744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96046e9-7c23-4082-a2eb-68cd0d0a4f72 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.563141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 759/1488] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:35:18.569550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acaa6c-14ff-443c-af50-4d687606eba6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.570016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acaa6c-14ff-443c-af50-4d687606eba6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.570120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acaa6c-14ff-443c-af50-4d687606eba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.588083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c8acaa6c-14ff-443c-af50-4d687606eba6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:18.589450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8acaa6c-14ff-443c-af50-4d687606eba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:18.597383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 730/1489] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:18.638668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96046e9-7c23-4082-a2eb-68cd0d0a4f72 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:18.649253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96046e9-7c23-4082-a2eb-68cd0d0a4f72 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:18.652751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:18.653387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:18.653672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:18.653953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:18.662947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:18.664389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b61c4-ccd9-4726-ae93-bc4840504507 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:18.673668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 760/1490] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:35:21.137070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c81e0-e430-41aa-ac14-d0d7843dbdb6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.137590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c81e0-e430-41aa-ac14-d0d7843dbdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.137590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c81e0-e430-41aa-ac14-d0d7843dbdb6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.138905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 731/1491] 10.222.0.102 () {54 vars in 931 bytes} [Thu May 26 16:35:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:35:21.144167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68171-1304-4a92-8c14-7290a1fef1c9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.145134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68171-1304-4a92-8c14-7290a1fef1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.145303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea68171-1304-4a92-8c14-7290a1fef1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.162616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2ea68171-1304-4a92-8c14-7290a1fef1c9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:35:21.163801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2ea68171-1304-4a92-8c14-7290a1fef1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:35:21.171471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 761/1492] 10.222.0.102 () {58 vars in 1028 bytes} [Thu May 26 16:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:35:21.210955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c81e0-e430-41aa-ac14-d0d7843dbdb6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:35:21.221619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c81e0-e430-41aa-ac14-d0d7843dbdb6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:35:21.225193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:35:21.225822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:35:21.226107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:35:21.226383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:35:21.235381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:35:21.236855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338b9e9-4ca0-47de-a99a-424baad67e3c service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:35:21.246294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 732/1493] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:35:31.157818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=33 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:35:31.242043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=33 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:02.768817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:02.769406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:02.769406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:02.787334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:02.788562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:02.797029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 762/1494] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:37:02.807020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:02.807568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:02.807568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:02.826524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:02.827747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:02.836042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 733/1495] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:37:02.840862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:02.850449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0d57e-0ee5-47ea-b836-122b6d5b6f53 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:02.855076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:02.855725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:02.856009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:02.856283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:02.857040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:37:02.857348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:02.858356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:02.858356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:37:02.858356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:37:02.859240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:02.871326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 763/1496] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:37:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:37:02.880142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:02.890919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36b48c-60e1-4eec-921b-60821d97d4a4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:02.895468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:02.896123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:02.896441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:02.896724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:02.897424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:02.899248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:02.899248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:37:02.899248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:37:02.900603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:02.942073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 734/1497] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:37:02 2022] POST /identity/v3/projects => generated 380 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:37:02.943371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:02.953750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d02941-eb49-4059-bc59-7bce885c6713 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.009977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.010645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.010931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.011209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.011894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.012935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:03.012935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:37:03.012935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:37:03.014136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.037348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 764/1498] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:37:02 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:37:03.038887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.049963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ca9d-4356-4368-9c2a-c93e50c44395 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.054792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.055451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.055738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.056017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.056776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.057820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:03.057820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:37:03.057820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:37:03.058711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.072598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 735/1499] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:37:03 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:37:03.076835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.086836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8275209-5b2a-4873-b81f-4654fe1b7b5f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.092044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.092747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.093030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.093305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.094360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.095374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:03.095374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:37:03.095374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:37:03.096268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb1799-5065-4d17-9e40-7f5d352fcf83 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.110156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 765/1500] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:37:03 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:37:03.115075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.125261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b2049-0e75-4619-89d9-9302b58a11c1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.130358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.131240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.131522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.131796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] PATH_INFO: `/v3/projects/42b9e7a9ca964836907e376bc9f52a12/users/bb3b1767e348404b8849e275a675eb41/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.147281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b9e7a9ca964836907e376bc9f52a12, user_id=bb3b1767e348404b8849e275a675eb41, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.148605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:03.148605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:37:03.148605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:37:03.150540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c517-f220-457e-8c7f-01274921a2e1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.165060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 736/1501] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:37:03 2022] PUT /identity/v3/projects/42b9e7a9ca964836907e376bc9f52a12/users/bb3b1767e348404b8849e275a675eb41/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:37:03.177033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888f17-73ad-4085-aac3-f53c0a5faaf3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.177340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888f17-73ad-4085-aac3-f53c0a5faaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.177647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9888f17-73ad-4085-aac3-f53c0a5faaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.203923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b9888f17-73ad-4085-aac3-f53c0a5faaf3 None None] MFA Rules not processed for user `bb3b1767e348404b8849e275a675eb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:03.205215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b9888f17-73ad-4085-aac3-f53c0a5faaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:03.269127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 766/1502] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:37:03.283176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029349-65bd-4bf2-94a2-b69d34a767b0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.283517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029349-65bd-4bf2-94a2-b69d34a767b0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.283804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b029349-65bd-4bf2-94a2-b69d34a767b0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.285306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 737/1503] 10.222.0.102 () {54 vars in 968 bytes} [Thu May 26 16:37:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:37:03.290193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd29d89-520b-4937-b185-aef2a0103323 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.290441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd29d89-520b-4937-b185-aef2a0103323 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.290730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd29d89-520b-4937-b185-aef2a0103323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.308585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fdd29d89-520b-4937-b185-aef2a0103323 None None] MFA Rules not processed for user `9dd18deb63da438cb8eee3d8e7daa955`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:03.309814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fdd29d89-520b-4937-b185-aef2a0103323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:03.353991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:03.363733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 767/1504] 10.222.0.102 () {58 vars in 1065 bytes} [Thu May 26 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:37:03.477514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b029349-65bd-4bf2-94a2-b69d34a767b0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.488317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b029349-65bd-4bf2-94a2-b69d34a767b0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.491920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.492598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.492886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.493168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.502797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.504258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.513893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 738/1505] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:37:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:37:03.557303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388940f-e213-42bb-9c4c-afb8441a37bc None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.557595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388940f-e213-42bb-9c4c-afb8441a37bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.557879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388940f-e213-42bb-9c4c-afb8441a37bc None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.559195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 768/1506] 10.222.0.102 () {52 vars in 834 bytes} [Thu May 26 16:37:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:37:03.564144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.627468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f958239-b6a9-4ffe-9e7a-83dc111e5c26 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.632392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.633293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.633575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.633853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] PATH_INFO: `/v3/users/bb3b1767e348404b8849e275a675eb41` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.635073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3b1767e348404b8849e275a675eb41)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.636102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:03.636102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:37:03.636102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:37:03.637379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.714442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3b1767e348404b8849e275a675eb41'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:03.715226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3b1767e348404b8849e275a675eb41'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:03.735439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3b1767e348404b8849e275a675eb41'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:03.745339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3b1767e348404b8849e275a675eb41'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:03.754895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:03.759437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3b1767e348404b8849e275a675eb41'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:03.767985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 739/1507] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:37:03 2022] DELETE /identity/v3/users/bb3b1767e348404b8849e275a675eb41 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:37:03.772710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.773190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.773307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.793257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:37:03.794415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:03.853798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 769/1508] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:37:03.863435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:03.864907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:03.922584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207354c-e710-4d22-81d2-579ba8e4a7a4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:03.926209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:03.926860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:03.927147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:03.927427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:03.936518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:03.937978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e022a9f-6594-4567-967e-3adba988c207 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:03.951247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 740/1509] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:37:04.293000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:37:04.294722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:37:04.310647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6862f-0b78-43bc-a362-fe0482b02ffa None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:37:04.325938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:37:04.325938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:37:04.325938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:37:04.325938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] PATH_INFO: `/v3/projects/42b9e7a9ca964836907e376bc9f52a12` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:37:04.326298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b9e7a9ca964836907e376bc9f52a12)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:37:04.326298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:37:04.326298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:37:04.326298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:37:04.326298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:37:04.394854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b9e7a9ca964836907e376bc9f52a12', 'request_id': 'req-0b76b9e9-a247-469f-8b12-f591acef775b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:04.405580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b9e7a9ca964836907e376bc9f52a12', 'request_id': 'req-0b76b9e9-a247-469f-8b12-f591acef775b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:04.420466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b9e7a9ca964836907e376bc9f52a12', 'request_id': 'req-0b76b9e9-a247-469f-8b12-f591acef775b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:04.432105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] The token cache is being invalidate because project 42b9e7a9ca964836907e376bc9f52a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:37:04.432423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:04.433303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0b76b9e9-a247-469f-8b12-f591acef775b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:37:04.434844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 770/1510] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:37:04 2022] DELETE /identity/v3/projects/42b9e7a9ca964836907e376bc9f52a12 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:37:13.945259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=29 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:37:14.428968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:38:51.560121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:51.560808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:51.560808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:51.562129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:38:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:51.568005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3752-3c76-4db8-9d20-8cf763e7394c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:51.568465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3752-3c76-4db8-9d20-8cf763e7394c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:51.568569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3752-3c76-4db8-9d20-8cf763e7394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:51.586892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e3d3752-3c76-4db8-9d20-8cf763e7394c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:51.588111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e3d3752-3c76-4db8-9d20-8cf763e7394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:51.646360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:38:51.816316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:51.818146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:51.895480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450c732-9208-42fc-a4d9-d43842e638b3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:51.901531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:51.902180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:51.902472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:51.902758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:51.911724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:51.913377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60f506-26c9-42d8-b5b9-0d2a9d116304 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:51.922762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 742/1513] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:38:52.816429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839674-3674-4f99-aeef-298ffa460e46 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:52.817078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839674-3674-4f99-aeef-298ffa460e46 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:52.817078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93839674-3674-4f99-aeef-298ffa460e46 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:52.818432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:38:52 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:38:52.823398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e14-d4a6-4404-b667-a13503ce7277 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:52.823860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e14-d4a6-4404-b667-a13503ce7277 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:52.824099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885e14-d4a6-4404-b667-a13503ce7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:52.842483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45885e14-d4a6-4404-b667-a13503ce7277 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:52.843683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45885e14-d4a6-4404-b667-a13503ce7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:52.852025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:38:53.022019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839674-3674-4f99-aeef-298ffa460e46 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:38:53.036515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93839674-3674-4f99-aeef-298ffa460e46 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:38:53.042018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:38:53.042661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:53.042949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:53.043229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:53.052230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:38:53.053974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f5bc2-ec5c-47a3-a9cf-ff83e0862f87 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:38:53.064595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 773/1516] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:38:53.330166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d251ed-d448-42f1-86c2-35f9dc31038b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:53.330407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d251ed-d448-42f1-86c2-35f9dc31038b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:53.330677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d251ed-d448-42f1-86c2-35f9dc31038b None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:53.332047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 744/1517] 10.222.0.47 () {54 vars in 929 bytes} [Thu May 26 16:38:53 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:38:53.351558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f7c34-ae3c-47d0-b2b0-1d396d0ad615 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:38:53.351859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f7c34-ae3c-47d0-b2b0-1d396d0ad615 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:38:53.352143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f7c34-ae3c-47d0-b2b0-1d396d0ad615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:38:53.371409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5b4f7c34-ae3c-47d0-b2b0-1d396d0ad615 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:38:53.372681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5b4f7c34-ae3c-47d0-b2b0-1d396d0ad615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:38:53.436295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 774/1518] 10.222.0.47 () {58 vars in 1019 bytes} [Thu May 26 16:38:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:39:02.837399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=37 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:03.427884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=62 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:03.881723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d005-7fcf-496d-9d2d-bca687d9a72b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:03.882249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d005-7fcf-496d-9d2d-bca687d9a72b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:03.882347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8d005-7fcf-496d-9d2d-bca687d9a72b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:03.883667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 745/1519] 10.222.0.102 () {54 vars in 965 bytes} [Thu May 26 16:39:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:39:03.888719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734a42-162a-444c-b119-a1228fcf2a44 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:03.888989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734a42-162a-444c-b119-a1228fcf2a44 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:03.889272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b734a42-162a-444c-b119-a1228fcf2a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:03.907822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3b734a42-162a-444c-b119-a1228fcf2a44 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:03.909042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b734a42-162a-444c-b119-a1228fcf2a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:03.917772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 775/1520] 10.222.0.102 () {58 vars in 1062 bytes} [Thu May 26 16:39:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:39:03.925170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d005-7fcf-496d-9d2d-bca687d9a72b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:03.939617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8d005-7fcf-496d-9d2d-bca687d9a72b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:03.946077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:03.946727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:03.947025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:03.947308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:03.956031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:03.958233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498e652-12fb-4a45-91c0-31a8ea677209 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:03.968707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 746/1521] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:04.327906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15132-3745-4d89-a5fa-c6251aa80cda None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:04.328226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15132-3745-4d89-a5fa-c6251aa80cda None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:04.328549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e15132-3745-4d89-a5fa-c6251aa80cda None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:04.329969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:39:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:39:04.334972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea8a6-c97d-4677-8d11-9325c5498c98 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:04.335344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea8a6-c97d-4677-8d11-9325c5498c98 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:04.335705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cea8a6-c97d-4677-8d11-9325c5498c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:04.353533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e3cea8a6-c97d-4677-8d11-9325c5498c98 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:04.354725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e3cea8a6-c97d-4677-8d11-9325c5498c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:04.363968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:39:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:39:04.518807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15132-3745-4d89-a5fa-c6251aa80cda None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:04.533099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e15132-3745-4d89-a5fa-c6251aa80cda None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:04.538922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:04.539580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:04.539888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:04.540134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:04.548289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:04.550552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f28c0-71b7-45af-951a-f7a25a0eda0c service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:04.560108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 777/1524] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:05.431241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c912a-14df-4470-9822-77af618c10cc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:05.431815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c912a-14df-4470-9822-77af618c10cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:05.431815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c912a-14df-4470-9822-77af618c10cc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:05.433360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 16:39:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:39:05.438597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3e44-2a61-49ee-ae2a-3de59411e078 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:05.438898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3e44-2a61-49ee-ae2a-3de59411e078 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:05.439181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee3e44-2a61-49ee-ae2a-3de59411e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:05.458982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3bee3e44-2a61-49ee-ae2a-3de59411e078 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:05.460096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3bee3e44-2a61-49ee-ae2a-3de59411e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:05.468052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 16:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:39:05.618717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c912a-14df-4470-9822-77af618c10cc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:05.633505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c912a-14df-4470-9822-77af618c10cc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:05.638865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:05.639497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:05.639805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:05.640069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:05.648113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:05.649758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c8574d-7bb9-43fd-8934-37b4b0897845 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:05.659163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 749/1527] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:10.101100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:10.101688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:10.101688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:10.103050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:39:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:39:10.108274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f490-7f76-48a7-ab90-fac6bb724645 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:10.108699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f490-7f76-48a7-ab90-fac6bb724645 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:10.108900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0f490-7f76-48a7-ab90-fac6bb724645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:10.127480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81b0f490-7f76-48a7-ab90-fac6bb724645 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:10.128736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81b0f490-7f76-48a7-ab90-fac6bb724645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:10.137071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:39:10.173751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:10.175457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:10.233458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa971e-06c0-443a-a7c1-115a8e7615f2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:10.237117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:10.237768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:10.238056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:10.238338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:10.247347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:10.248825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50656d98-81ef-4fd8-b6b4-d40feb7564de service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:10.258269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 780/1530] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:12.493308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:12.493912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:12.493912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:12.495263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:39:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:39:12.500644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77027d6-d699-434f-9c3d-7434646f5522 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:12.501140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77027d6-d699-434f-9c3d-7434646f5522 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:12.501299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77027d6-d699-434f-9c3d-7434646f5522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:12.522089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f77027d6-d699-434f-9c3d-7434646f5522 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:12.523318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f77027d6-d699-434f-9c3d-7434646f5522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:12.532256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:39:12.569319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:12.571116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:12.584081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2ca84-79e9-4968-bf80-ba2a9e7a1d55 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:12.587612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:12.588246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:12.588581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:12.588868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:12.597682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:12.599123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5410f6b-009a-4138-9cd7-327c74afe1ff service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:12.608516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 752/1533] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:16.346177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:16.347401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:16.347401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:16.348858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:39:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:39:16.354345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298b3d-dbe0-42f7-8c11-a48a02e93240 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:16.354773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298b3d-dbe0-42f7-8c11-a48a02e93240 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:16.354916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298b3d-dbe0-42f7-8c11-a48a02e93240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:16.377926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d8298b3d-dbe0-42f7-8c11-a48a02e93240 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:16.379125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d8298b3d-dbe0-42f7-8c11-a48a02e93240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:16.386954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:39:16.664036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:16.665739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:16.723584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c3bfd-86d7-4e50-b516-eb8d40a3df59 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:16.727135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:16.727778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:16.728065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:16.728345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:16.737854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:16.739288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e4ae6-b1e3-4bca-814f-b1a80fbc189e service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:16.748928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 783/1536] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:18.982964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:18.983557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:18.983557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:18.985050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 16:39:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:39:18.991269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430fb2-00c8-4b63-beaa-12861f3552c2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:18.991733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430fb2-00c8-4b63-beaa-12861f3552c2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:18.991837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b430fb2-00c8-4b63-beaa-12861f3552c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:19.009708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3b430fb2-00c8-4b63-beaa-12861f3552c2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:39:19.010906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3b430fb2-00c8-4b63-beaa-12861f3552c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:19.019057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 16:39:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:39:19.288811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:39:19.290584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:39:19.303430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324b84-bc27-4317-ad2d-42bd3c371aad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:39:19.306977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:39:19.307618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:39:19.307906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:39:19.308194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:39:19.317767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:39:19.319207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1c38a-d6fb-4ecc-a4e3-5a822e3df104 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:39:19.328668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 755/1539] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:39:29.004495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=70 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:39:29.324384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=33 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:56.524939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e44902-c5a3-4516-af1e-73b341fd01c3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.525587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e44902-c5a3-4516-af1e-73b341fd01c3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.525587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e44902-c5a3-4516-af1e-73b341fd01c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.556061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-41e44902-c5a3-4516-af1e-73b341fd01c3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:56.557319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-41e44902-c5a3-4516-af1e-73b341fd01c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:56.570290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 785/1540] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:56.580987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.581595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.581595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.607900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2705-3fdb-4d75-9cb2-57ff4fca3680 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.608324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2705-3fdb-4d75-9cb2-57ff4fca3680 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.608646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd2705-3fdb-4d75-9cb2-57ff4fca3680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.611080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:56.612310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:56.629012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 756/1541] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:56.634840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:56.640733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-71dd2705-3fdb-4d75-9cb2-57ff4fca3680 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:56.642083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-71dd2705-3fdb-4d75-9cb2-57ff4fca3680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:56.644544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d447-96f1-41a3-840f-22d4e98cc57d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:56.657437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:56.658138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.658429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.658711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.659490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:56.659808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:56.660928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 16:40:56.660928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:40:56.660928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:40:56.661874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:56.669399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 786/1542] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:40:56.686172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a68024-2b55-4017-937e-454630c35064 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.686543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a68024-2b55-4017-937e-454630c35064 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.686752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a68024-2b55-4017-937e-454630c35064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.697901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 757/1543] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:40:56.717131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f9a68024-2b55-4017-937e-454630c35064 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:56.718433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f9a68024-2b55-4017-937e-454630c35064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:56.725487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:56.736864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc412ade-c167-4957-9869-9b03ae4f4f74 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:56.750446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 787/1544] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:56.754552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:56.755698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a68024-2b55-4017-937e-454630c35064 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:56.759767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.760061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.760343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.761089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:56.763047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:56.777742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a68024-2b55-4017-937e-454630c35064 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:56.796972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:56.797659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.797947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.798231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.798970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:56.799279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:56.811690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434a9a5-aea3-4d5b-b62d-cb5b78c98b18 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:56.833183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 758/1545] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/projects => generated 380 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:40:56.837886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:56.848734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 788/1546] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:56 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:56.851854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743a9e-082b-4b47-a12f-11e8177513c6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:56.853539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743a9e-082b-4b47-a12f-11e8177513c6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:56.853903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743a9e-082b-4b47-a12f-11e8177513c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:56.900989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bd743a9e-082b-4b47-a12f-11e8177513c6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:56.902241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bd743a9e-082b-4b47-a12f-11e8177513c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.003983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 789/1547] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 16:40:57.005741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e405d-5964-4b56-874b-f4485697d573 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.006283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e405d-5964-4b56-874b-f4485697d573 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.006559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554001df-852c-4d66-8998-36c0dcdd3915 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.007016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e405d-5964-4b56-874b-f4485697d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.019854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.020956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.021484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.023714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.024691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.026013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:40:57.026013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:40:57.026013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:40:57.033896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bde9a-ad49-4295-ae18-53c3e4bd8379 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.044946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-937e405d-5964-4b56-874b-f4485697d573 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.046408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-937e405d-5964-4b56-874b-f4485697d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.062342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 790/1548] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.063322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e405d-5964-4b56-874b-f4485697d573 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.066173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 759/1549] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:56 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:40:57.067686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4115-ebb3-4346-8639-9348c74d5944 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.068218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4115-ebb3-4346-8639-9348c74d5944 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.068732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de4115-ebb3-4346-8639-9348c74d5944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.083006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e405d-5964-4b56-874b-f4485697d573 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.087809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.088439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.088724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.089000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.089698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.090725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:40:57.090725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:40:57.090725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:40:57.091939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471f004-59ac-4419-8e24-987a86e15697 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.092836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-28de4115-ebb3-4346-8639-9348c74d5944 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.094042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-28de4115-ebb3-4346-8639-9348c74d5944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.103126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 760/1550] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.104650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717709-b696-44b8-a65a-73db5b8e140b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.104785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717709-b696-44b8-a65a-73db5b8e140b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.105047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33717709-b696-44b8-a65a-73db5b8e140b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.121825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 791/1551] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 388 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.123206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.123473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.123730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.124597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-33717709-b696-44b8-a65a-73db5b8e140b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.126379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-33717709-b696-44b8-a65a-73db5b8e140b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.141623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.142835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.196190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 761/1552] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.196815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b98-f878-4f72-a1f8-686bf301f2ac None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.197115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b98-f878-4f72-a1f8-686bf301f2ac None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.197403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e71b98-f878-4f72-a1f8-686bf301f2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.215807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 792/1553] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.217184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.218473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-31e71b98-f878-4f72-a1f8-686bf301f2ac None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.219812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-31e71b98-f878-4f72-a1f8-686bf301f2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.228584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d4ef6-e9c0-4a7d-bace-7f30ab2a3b9b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.229332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 762/1554] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.231030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e53-942e-40b4-9fc4-20dde340563f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.231323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e53-942e-40b4-9fc4-20dde340563f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.231603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a2e53-942e-40b4-9fc4-20dde340563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.239470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.240171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.240497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.240778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.241528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.243282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c94c0c-940b-4638-9888-d0463ed7c5e1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.251822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-442a2e53-942e-40b4-9fc4-20dde340563f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.252203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-442a2e53-942e-40b4-9fc4-20dde340563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.260054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 763/1555] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.261330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.261614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.261889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.265265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 793/1556] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:57.265265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14942-3947-444d-9731-367b94c6104a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.265265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14942-3947-444d-9731-367b94c6104a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.265265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b14942-3947-444d-9731-367b94c6104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.283176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f5b14942-3947-444d-9731-367b94c6104a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.283479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.284396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f5b14942-3947-444d-9731-367b94c6104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.284674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.292939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 794/1557] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.293511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14942-3947-444d-9731-367b94c6104a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.293947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 764/1558] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.297480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.305974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b14942-3947-444d-9731-367b94c6104a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.307985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed6075-0ae5-4075-8f60-a833cbed87ae None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.311761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.312474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.312743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.312881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.313528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.313620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.313960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.314218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.314356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.314926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.315234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.316334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7d910-6ae1-4355-84cf-f85c77f6f669 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.316856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49a6ef-991a-471f-89ff-ea240419764b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.331348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 765/1559] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.332827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.333096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.333385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.339080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 795/1560] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.340341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.340683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.340966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.348058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:57.354717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.355977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.360955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.362510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.364351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 766/1561] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.365297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.370369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:57.371205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 796/1562] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.375436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.377159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914f5fe-f06f-474c-a131-6a0f505f4867 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.382914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.383563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.383846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.384151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.384923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.385143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247564d-db33-4831-9d6e-3b0ea7478c64 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.385262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.386893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.389780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.390451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.390738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.391019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.391748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.393410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c18d1b7-672a-43ff-8444-a0867a199971 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.400262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 767/1563] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.401135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.407727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 797/1564] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:57.407727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.407727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.407727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.413705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a844b0-a690-401d-a234-b8289023d649 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.419039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.419710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.420002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.420801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.421554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.421871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.423542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.425708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.426926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.435057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 798/1565] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:57.435836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.440271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 768/1566] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.441048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.452510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541126b-f744-42e7-be88-c35f59961a6e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.452740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9256-584c-4b03-bfa4-adb7b60765ab admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.457281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.457430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.457936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.458036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.458230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.458347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.458512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.458628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.459241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.459342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.461423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.461811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.471768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 769/1567] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:57.472627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.483651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4858c-5c0d-4e98-a0c1-4f12193cd54b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.488523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.489173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.489463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.489747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.490484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.490859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.494763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 799/1568] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 376 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.494763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.495047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.510951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 770/1569] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.511929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.522603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908a213-3a71-4b6f-b406-81b68df2a8c8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.557828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dbc5f-22fc-4147-aef6-31ee46283885 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.562636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.563295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.563582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.564116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.564878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.565182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.566778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.578900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 800/1570] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.579688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.586992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.587736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.588092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.588477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.589303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.591336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.595665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89761147-1bf9-48a9-8161-9744ea2af5cb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.600307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.601252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.601506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.601784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] PATH_INFO: `/v3/projects/86b15e7956a347cba0b1dca0a45c8482/users/20b7990551ac458cb94c8bc922152650/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.618472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b15e7956a347cba0b1dca0a45c8482, user_id=20b7990551ac458cb94c8bc922152650, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.618719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 771/1571] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 374 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.619489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.621631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:40:57.621631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:40:57.621631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:40:57.623820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.638550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 801/1572] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:57 2022] PUT /identity/v3/projects/86b15e7956a347cba0b1dca0a45c8482/users/20b7990551ac458cb94c8bc922152650/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:57.639649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.685341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a2ecb1-e37d-487b-b278-cfefb2a2e4c2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.707008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ddce9-5990-450f-b3df-1b032e3ed963 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.712411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.713087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.713375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.713990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.714370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.716304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.734109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:57.747401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 802/1573] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 394 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.748243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.753657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.754324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.754645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.754917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.755646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:40:57.755954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.758144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.762412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:57.770569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 772/1574] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:40:57.771395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.787447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153bc07-8731-45e5-b478-17a928e3cddd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.822558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f619c-a0ea-4407-b825-716143920b2d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.827326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.828014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.828307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.828639 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.829384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.831008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.845728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 803/1575] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:57 2022] GET /identity/v3/roles => generated 1427 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:57.845728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.846799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.847478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.847767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.848048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.848803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.850764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.855924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d10cbb-440d-4b36-9e40-6dd0a936a894 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.862042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.862713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.862997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.863317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.864005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.865926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.872266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 773/1576] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.876260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.886500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99353a-18ff-4d29-bc41-036871030cbd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:57.891563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:57.892246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.892578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.892870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.893567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:57.895501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e079f54-e5f6-4992-aa30-c1f47e812b57 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:57.905652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 804/1577] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 368 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.906903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:57.927140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 774/1578] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/projects => generated 374 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:57.928480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:57.928786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:57.929069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:57.948748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:57.950153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:57.982729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd36762-a73c-41f2-8b86-0f1df06fd533 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.018797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 775/1579] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:58.020561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.035761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e4811-fce2-44d4-811e-2e74efbe15a3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.043480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.044585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.044953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.045407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.046577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.049982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.067300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.068138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.068640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.068990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.070025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.073969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.081949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 776/1580] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/users => generated 298 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.083355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.097241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aa955-3619-4ef3-9832-3ce2dd3c0144 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.103455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 805/1581] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:57 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.103455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.103703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.104162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.104545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.104903 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.105792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.108626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.111922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a4588-f127-4464-aeeb-dbff47c41aeb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.116648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.118025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.118317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.118595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] PATH_INFO: `/v3/projects/a69cba8eb64f4fcc87bbc6960a0abeb0/users/e4941664ae624d4190ff53e5965db33f/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.135868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69cba8eb64f4fcc87bbc6960a0abeb0, user_id=e4941664ae624d4190ff53e5965db33f, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.138649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.142250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 777/1582] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/projects => generated 384 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.142250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.149185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:58.149508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:58.155478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 806/1583] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:58 2022] PUT /identity/v3/projects/a69cba8eb64f4fcc87bbc6960a0abeb0/users/e4941664ae624d4190ff53e5965db33f/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:58.156598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.206879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15408ae8-ff62-4cf2-85cd-ae4cf2952e99 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.225919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada835d-aec1-4b65-8a01-1f0a8c7a713c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.231134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.231814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.232108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.232416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.233124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.235115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.259411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 807/1584] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.260550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.274402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777de3f0-1edf-405c-ab33-a02af71e73f1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.277639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.278465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.278831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.279244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.280113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.280949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.281934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.282132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.282362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.282783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.283857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.287112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.293671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 778/1585] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.294695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.316617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 808/1586] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.320980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.331598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2efcb4-57a8-4419-8aad-1d6e50d6fe82 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.336358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.337052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.337346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.337630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.338361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.339979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.351929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 809/1587] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.352610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.357216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c246-1c7a-4b85-b99d-6e61f4e4ae13 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.361450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.362252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.362508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b040dbb-60b0-4351-a026-d7c1cb217ec5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.362609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.362814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.367008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.368181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.368478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.368762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.369496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.371101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.373291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.374783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517f22e-21c9-4e1b-bcf4-876d4c97b345 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.381556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 810/1588] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.382732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.385499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 779/1589] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:58.386836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.387266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.387556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.392314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6b2b4-1282-4cc3-a968-060b51d52a96 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.396998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.397679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.397974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.398297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.398998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.400995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.405965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:58.407233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:58.416889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 780/1590] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:58.417937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.425507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 811/1591] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:40:58 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:40:58.428819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0d192-b749-410f-b6a8-bb97e5d4c962 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.430759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.442389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.442554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f2af6-b864-46d3-b300-d35b4b285432 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.443794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.443794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.444006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.444728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.446603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.448475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.449433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.449818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.450197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.450993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.452775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.459877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 781/1592] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.460843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.465585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 812/1593] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.466657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.474406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f2ebb-b3d2-4b57-865e-f789849c22a1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.478936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c74a6-2f8a-49e0-b490-e826be67a32a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.483176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.483893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.484341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.484678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.484965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.485422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.485785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.486074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.486434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.487058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.487314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.489214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.506754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 813/1594] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.507012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 782/1595] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.507112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.507193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.516117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fde2f-c3ee-4e6d-8e08-7033391a0e3d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.518570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247017e-b798-4ab2-8e0f-0bc8772ebf00 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.522026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.522879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.523362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.523494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.523675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.524201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.524326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.524650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.525089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.525817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.525930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.527404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.538497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 814/1596] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.540595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 783/1597] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.543990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.544455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.555227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e124e-7a4b-447c-91c4-bc50d2131034 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.557937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d10d-025c-469d-9f9c-f9b6f943fe83 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.559897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.560774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.561208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.561620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.564574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.565317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.565663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.566015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.566825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.568689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.572526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.574048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.582430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 784/1598] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.583445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.588410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 815/1599] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:58.588869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:58.591268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.598907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a70c4b-5259-4bde-bb0c-27ed55bbbcdc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.606930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.607223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60aec96-4a9b-4273-87ff-804794bcd5b9 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.608941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.609413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.610120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] PATH_INFO: `/v3/projects/769867aa4086443a809d8fd8d3b605e2/users/2e5e1735e7f54f2d8943a0f55311394b/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.616890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.616890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.616890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.616890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.618035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.619927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.637374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 816/1600] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:58.637374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.637686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769867aa4086443a809d8fd8d3b605e2, user_id=2e5e1735e7f54f2d8943a0f55311394b, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.640220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.651548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15662d27-69a4-429b-8b4c-3c8a2c390a91 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.656328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 785/1601] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:58 2022] PUT /identity/v3/projects/769867aa4086443a809d8fd8d3b605e2/users/2e5e1735e7f54f2d8943a0f55311394b/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:58.657465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.703102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:58.744092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.745524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.746307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.746605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] PATH_INFO: `/v3/projects/a85ded3a20964dbbbc354199f5129d9b/users/9330e65e73394f18b87c5b1d5d47f564/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.767450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85ded3a20964dbbbc354199f5129d9b, user_id=9330e65e73394f18b87c5b1d5d47f564, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.767901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d0e64-aaa8-4111-be14-c968d7d23bc5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.771035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.776774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.777665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.777956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.778240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] PATH_INFO: `/v3/projects/17477531deb44fe88e22af96c9067647/users/104a0314044d441c86a94847a83bd9ff/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:58.794955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 817/1602] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:58 2022] PUT /identity/v3/projects/a85ded3a20964dbbbc354199f5129d9b/users/9330e65e73394f18b87c5b1d5d47f564/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:58.794955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.814920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17477531deb44fe88e22af96c9067647, user_id=104a0314044d441c86a94847a83bd9ff, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:58.819419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:58.842698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 786/1603] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:58 2022] PUT /identity/v3/projects/17477531deb44fe88e22af96c9067647/users/104a0314044d441c86a94847a83bd9ff/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:58.843914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:58.917183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d2527-b90e-44ea-9f1a-2f2f02d9f5ad admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.973652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c63eaf-dc14-4ea7-bff8-5b660c73414c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:58.987806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:58.988914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:58.989223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:58.989631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] PATH_INFO: `/v3/projects/92f59916468749d7b3f0a41b9ede29b3/users/a10274a364b34cc689aba9e2e6b0c113/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.002825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:59.004079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.005235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.005751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.007944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.010777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.011274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92f59916468749d7b3f0a41b9ede29b3, user_id=a10274a364b34cc689aba9e2e6b0c113, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.014697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e2903-2cbc-48ea-9277-952f5e375550 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.028746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 818/1604] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:40:58 2022] GET /identity/v3/roles => generated 1427 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:40:59.030908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:59.042249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 787/1605] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:58 2022] PUT /identity/v3/projects/92f59916468749d7b3f0a41b9ede29b3/users/a10274a364b34cc689aba9e2e6b0c113/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:59.043974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b510-5d6b-49f1-8921-911aff9652a1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.044527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b510-5d6b-49f1-8921-911aff9652a1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.044965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139b510-5d6b-49f1-8921-911aff9652a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.058041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dfe7-d0c0-40a8-adf3-b5c315c5168b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:59.077273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8139b510-5d6b-49f1-8921-911aff9652a1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.078855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8139b510-5d6b-49f1-8921-911aff9652a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.154604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:59.155329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.155586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.155885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.156558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] PATH_INFO: `/v3/projects/adace30fd6d94630a8bbf637826c4cfe/users/bd98a8a14cf44e3ba2680a230f0cab7a/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.161880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.179978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adace30fd6d94630a8bbf637826c4cfe, user_id=bd98a8a14cf44e3ba2680a230f0cab7a, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.183365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3106ce-9d6b-49a5-9060-2207b8909bc4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.194668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 788/1606] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.197684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.198575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.199136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.212176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 819/1607] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:59 2022] PUT /identity/v3/projects/adace30fd6d94630a8bbf637826c4cfe/users/bd98a8a14cf44e3ba2680a230f0cab7a/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:59.213764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15ab-d22e-459b-bc57-c7b9846a8ab3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.214073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15ab-d22e-459b-bc57-c7b9846a8ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.214357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c15ab-d22e-459b-bc57-c7b9846a8ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.227542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.230069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.259229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-418c15ab-d22e-459b-bc57-c7b9846a8ab3 None None] MFA Rules not processed for user `104a0314044d441c86a94847a83bd9ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.261131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-418c15ab-d22e-459b-bc57-c7b9846a8ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.338083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 789/1608] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.339038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:59.351618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e341f9-8615-4ed7-a366-e5112a7ddf86 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:59.358284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 820/1609] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.359590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:59.359941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.360341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.360605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.360904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.361175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.361398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] PATH_INFO: `/v3/projects/f7449f3a96c8444a8efdb118290cc4e0/users/602566fb23bc463c834d92cdc035fbd7/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.410246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7449f3a96c8444a8efdb118290cc4e0, user_id=602566fb23bc463c834d92cdc035fbd7, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.413592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f095d-1038-45fe-b1fe-219747669454 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.436973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] MFA Rules not processed for user `a10274a364b34cc689aba9e2e6b0c113`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.439768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.452999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 790/1610] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:40:59 2022] PUT /identity/v3/projects/f7449f3a96c8444a8efdb118290cc4e0/users/602566fb23bc463c834d92cdc035fbd7/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:40:59.454926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.456081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.456710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.498856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] MFA Rules not processed for user `bd98a8a14cf44e3ba2680a230f0cab7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.502459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.567334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 821/1611] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.569015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:59.625489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 791/1612] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.627044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:59.650695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73808b31-9d8b-4c85-aa43-344c72625130 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:59.655594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:59.656412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.656867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.657260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.663538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d6cc2-5fd4-401d-8f75-a36b4e15a005 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:40:59.676238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:40:59.677179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.680061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.680597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.683295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.751316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.755570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bd561-65b8-4875-8b51-ae95e4a69f04 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.771462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:40:59.785745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 822/1613] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:59.788717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371fcf-170a-4a48-b8e7-9b7bf42e14c0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.789875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371fcf-170a-4a48-b8e7-9b7bf42e14c0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.790320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e371fcf-170a-4a48-b8e7-9b7bf42e14c0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.790511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:40:59.792187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b4817-9662-4611-9c3a-1ddde9150744 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:40:59.792917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 823/1614] 10.222.0.102 () {54 vars in 966 bytes} [Thu May 26 16:40:59 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:59.795072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba9eca-d4a0-45e6-80fd-bdfa5f764580 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.795584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba9eca-d4a0-45e6-80fd-bdfa5f764580 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.796489 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba9eca-d4a0-45e6-80fd-bdfa5f764580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.809247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 792/1615] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:40:59.811102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.811736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.812123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.842231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-84ba9eca-d4a0-45e6-80fd-bdfa5f764580 None None] MFA Rules not processed for user `20b7990551ac458cb94c8bc922152650`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.843854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-84ba9eca-d4a0-45e6-80fd-bdfa5f764580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.857675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] MFA Rules not processed for user `602566fb23bc463c834d92cdc035fbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:40:59.859358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:40:59.953771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 793/1616] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.955740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:40:59.971495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 824/1617] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:40:59.972814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1883-fdcf-4a9b-be96-eae7bc10ac6d None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.973153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1883-fdcf-4a9b-be96-eae7bc10ac6d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.973528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f1883-fdcf-4a9b-be96-eae7bc10ac6d None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:40:59.975199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 825/1618] 10.222.0.102 () {54 vars in 966 bytes} [Thu May 26 16:40:59 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:40:59.976165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fd30-873b-41a5-bd01-df961ca6f380 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:40:59.977109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fd30-873b-41a5-bd01-df961ca6f380 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:40:59.978238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391fd30-873b-41a5-bd01-df961ca6f380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.000138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d391fd30-873b-41a5-bd01-df961ca6f380 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:00.002051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d391fd30-873b-41a5-bd01-df961ca6f380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:00.047103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13fc037-25d6-47e0-becd-1a326f8b4f44 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:00.052039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:00.052748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.053142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.053526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.066553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:00.071270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18fdda-d50b-4838-adef-0794d272610d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:00.098282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 794/1619] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:40:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:00.099821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.101735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.101735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.112905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 826/1620] 10.222.0.102 () {58 vars in 1063 bytes} [Thu May 26 16:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:00.115042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.115042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.115507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.141923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] MFA Rules not processed for user `20b7990551ac458cb94c8bc922152650`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:00.143617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:00.144517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:00.145715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:00.154606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 827/1621] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:00.155369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:00.170327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 795/1622] 10.222.0.102 () {58 vars in 1063 bytes} [Thu May 26 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:00.171037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:00.172006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47649700-8ce6-4da7-962e-265b97bc9b3a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:00.186919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:00.187144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.187261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c98fc4b-8b07-40d4-a96b-8567a8c221da None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:00.187378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.187690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.197400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:00.198241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.198639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.198932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.216452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:00.218881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ecac4-f09a-4a95-9b38-07e98f966495 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:00.229378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:00.236894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 796/1623] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:00.297842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:00.300181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee257775-2e09-4cd8-9f37-3efae182623a service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:00.317233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 828/1624] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:00.565431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ac9a-740c-437b-b488-bf2060f6fe22 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.566078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ac9a-740c-437b-b488-bf2060f6fe22 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.566689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1ac9a-740c-437b-b488-bf2060f6fe22 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.568802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 797/1625] 10.222.0.102 () {54 vars in 917 bytes} [Thu May 26 16:41:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:00.577789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.578368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.578477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.604771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:00.607135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:00.629238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 829/1626] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:00.639487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ac9a-740c-437b-b488-bf2060f6fe22 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:00.656255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1ac9a-740c-437b-b488-bf2060f6fe22 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:00.665837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:00.667074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.668048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.669702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.690998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:00.692656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d4a38-8eb9-49fb-b917-35b13f8070dd service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:00.714884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 798/1627] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:00.721381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:00.738774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc611cdb-2048-4467-9103-6a12c87e6a5f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:00.747564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:00.748711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.749294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.749786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.761805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:00.763674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc07bf-1aaf-484e-9d38-0cdbd7762a2e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:00.775151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 830/1628] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:00.855050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88495-8bb6-4be4-9df8-585c7582f1c3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.855393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88495-8bb6-4be4-9df8-585c7582f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.855734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef88495-8bb6-4be4-9df8-585c7582f1c3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.857270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 799/1629] 10.222.0.102 () {54 vars in 917 bytes} [Thu May 26 16:41:00 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:00.873884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:00.874212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:00.876344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:00.901470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:00.903978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:00.922296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 831/1630] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:41:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:01.019240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef88495-8bb6-4be4-9df8-585c7582f1c3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:01.037034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef88495-8bb6-4be4-9df8-585c7582f1c3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:01.043178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:01.044277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:01.044689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:01.045319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:01.064542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:01.066058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:01.093087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 800/1631] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:01.750984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:01.765848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee0d0-4dec-4927-9e6f-08378d302f08 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:01.782707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:01.783447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:01.783743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:01.784047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:01.812230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:01.815631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0fbf1-4912-4095-98da-55ca6ef7ce0a service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:01.852010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 832/1632] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:02.251763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:02.264020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68bc441-1021-4211-b1ca-b0a0b1eefec2 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:02.271411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:02.272597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.273104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.273645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] PATH_INFO: `/v3/users/104a0314044d441c86a94847a83bd9ff` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.275189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] RBAC: Authorizing `identity:delete_user(user_id=104a0314044d441c86a94847a83bd9ff)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:02.277957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:02.320215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:02.354653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104a0314044d441c86a94847a83bd9ff'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:02.355476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104a0314044d441c86a94847a83bd9ff'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:02.375667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104a0314044d441c86a94847a83bd9ff'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:02.388015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104a0314044d441c86a94847a83bd9ff'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:02.401929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104a0314044d441c86a94847a83bd9ff'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:02.415589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 801/1633] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:02 2022] DELETE /identity/v3/users/104a0314044d441c86a94847a83bd9ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:02.417510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63cb52-b81a-42eb-b9fd-368b7e8ddce0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.417810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63cb52-b81a-42eb-b9fd-368b7e8ddce0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.418090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63cb52-b81a-42eb-b9fd-368b7e8ddce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.440848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0f63cb52-b81a-42eb-b9fd-368b7e8ddce0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:02.442220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0f63cb52-b81a-42eb-b9fd-368b7e8ddce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:02.518456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 833/1634] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:02.531552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:02.533370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:02.630249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728be27-8cbf-4be4-9312-247010f2bd6b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.630835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728be27-8cbf-4be4-9312-247010f2bd6b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.631352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728be27-8cbf-4be4-9312-247010f2bd6b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.634772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 834/1635] 10.222.0.102 () {54 vars in 917 bytes} [Thu May 26 16:41:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:02.653264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6b8d6-203e-4a23-9d56-99cc31e9931c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:02.658386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3909a-fb4b-4cbf-82bb-cb509d36b8f6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.658786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3909a-fb4b-4cbf-82bb-cb509d36b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.658902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:02.659125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3909a-fb4b-4cbf-82bb-cb509d36b8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.659683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.659979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.660311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.678160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:02.680443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:02.693655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 802/1636] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:02.717191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2eb3909a-fb4b-4cbf-82bb-cb509d36b8f6 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:02.719585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2eb3909a-fb4b-4cbf-82bb-cb509d36b8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:02.729306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 835/1637] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:41:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:02.755224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:02.757045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:02.782278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a2a92-2e2d-4c77-8e5d-5dfea1c1fe20 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:02.800789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:02.802025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:02.802787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:02.803421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:02.814981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:02.817642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dd76f-4e9e-4f0f-b880-dc49aa8a5d6e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:02.832307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 803/1638] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:04.048732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46bc7-a278-4ec2-a6ab-cb2233b0f103 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:04.049235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46bc7-a278-4ec2-a6ab-cb2233b0f103 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:04.049318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd46bc7-a278-4ec2-a6ab-cb2233b0f103 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:04.051101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 836/1639] 10.222.0.102 () {54 vars in 965 bytes} [Thu May 26 16:41:04 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:04.065142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:04.065647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:04.066173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:04.117807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:04.122345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:04.351363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 804/1640] 10.222.0.102 () {58 vars in 1062 bytes} [Thu May 26 16:41:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:04.360226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd46bc7-a278-4ec2-a6ab-cb2233b0f103 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:04.387079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd46bc7-a278-4ec2-a6ab-cb2233b0f103 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:04.399538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:04.401826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:04.404668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:04.405161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:04.409890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:04.449160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:04.457410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4f0fb-9998-4e92-85b0-c05489b8e3b4 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:04.503265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 837/1641] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:04.713018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:04.717603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:04.756176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeb8e1e-4c05-4cf6-93d5-641dd430a4b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:04.765381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:04.766552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:04.766915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:04.767365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] PATH_INFO: `/v3/projects/17477531deb44fe88e22af96c9067647` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:04.769720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17477531deb44fe88e22af96c9067647)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:04.773120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:41:04.773120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 26 16:41:04.773120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: May 26 16:41:04.779073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:04.889326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:04.965130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17477531deb44fe88e22af96c9067647', 'request_id': 'req-8621128e-6281-4fda-8f15-dc547410a8a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:04.975120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17477531deb44fe88e22af96c9067647', 'request_id': 'req-8621128e-6281-4fda-8f15-dc547410a8a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:04.991422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17477531deb44fe88e22af96c9067647', 'request_id': 'req-8621128e-6281-4fda-8f15-dc547410a8a4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.031807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] The token cache is being invalidate because project 17477531deb44fe88e22af96c9067647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:05.031807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.033791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.035699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 805/1642] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:04 2022] DELETE /identity/v3/projects/17477531deb44fe88e22af96c9067647 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:05.041189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e4b2-7a19-4880-8f88-cb57675003f2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.041611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e4b2-7a19-4880-8f88-cb57675003f2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.042083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e4b2-7a19-4880-8f88-cb57675003f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.097343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-50c6e4b2-7a19-4880-8f88-cb57675003f2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:05.099952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-50c6e4b2-7a19-4880-8f88-cb57675003f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:05.208708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:05.214967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:05.243631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:05.304189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 838/1643] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:05.306002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.306306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.306589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.391160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:05.392471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:05.427790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 839/1644] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:05.437823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:05.476780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595ff59-55c9-4f8d-9084-073003d6197f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:05.485620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621128e-6281-4fda-8f15-dc547410a8a4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:05.502011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:05.502808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.503063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.503396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.504629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:05.504883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:05.508472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:05.512887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:05.514622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.514915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.515197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] PATH_INFO: `/v3/users/bd98a8a14cf44e3ba2680a230f0cab7a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.520965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd98a8a14cf44e3ba2680a230f0cab7a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:05.523057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:05.548747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 840/1645] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:05.549737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:05.571305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4150b7-8f94-4655-ab97-dd2eecbe6042 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:05.593415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:05.594106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.594395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.594668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.595529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:05.601644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:05.667871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 841/1646] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:05 2022] POST /identity/v3/projects => generated 372 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:05.669571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:05.759192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd98a8a14cf44e3ba2680a230f0cab7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.760678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd98a8a14cf44e3ba2680a230f0cab7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.853816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e9fe4d-424a-4707-a824-e0545cd22a8f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:05.857917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd98a8a14cf44e3ba2680a230f0cab7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.871448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:05.872339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.872977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.873494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.874485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:05.876883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:05.887459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd98a8a14cf44e3ba2680a230f0cab7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.907720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 842/1647] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:05 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:05.910101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:05.919250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2459c96-43f3-4665-b915-881c8aad3aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd98a8a14cf44e3ba2680a230f0cab7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:05.927774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24466daa-3294-40f8-8850-dbc11d4c345a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:05.948488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 806/1648] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:05 2022] DELETE /identity/v3/users/bd98a8a14cf44e3ba2680a230f0cab7a => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:05.951896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.952284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.954633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.988777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:05.989484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:05.989783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:05.990072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:05.990821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:05.993260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:06.009278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:06.013622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:06.032637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 843/1649] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:05 2022] GET /identity/v3/roles => generated 1427 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:06.045983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:06.050428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:06.094345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:06.115926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2103aa-02da-442c-a86c-b8ecae5d0b45 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:06.275320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 807/1650] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:06.329377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:06.331836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:06.380778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:06.381939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:06.382384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:06.383062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:06.383967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:06.390254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:06.421668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 844/1651] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:06 2022] GET /identity/v3/roles => generated 1427 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:06.426120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:06.445694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8325dad-0f1e-4439-a691-e436ad6631ae admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:06.456443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:06.457627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:06.458050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:06.458463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] PATH_INFO: `/v3/projects/17ec6aa33dbb451e8b1114b0e7d9b49f/users/b9a21cf57bbe40c88119da70b2d3e337/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:06.502428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ec6aa33dbb451e8b1114b0e7d9b49f, user_id=b9a21cf57bbe40c88119da70b2d3e337, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:06.516860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf35288-537c-4b00-9a5c-c81890861572 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:06.545454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43788-43a6-474e-8fb8-a10851fe03b9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:06.594619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 845/1652] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:06 2022] PUT /identity/v3/projects/17ec6aa33dbb451e8b1114b0e7d9b49f/users/b9a21cf57bbe40c88119da70b2d3e337/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:06.606194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:06.606743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:06.607171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:06.641839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:06.678518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:06.679381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:06.679806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] MFA Rules not processed for user `b9a21cf57bbe40c88119da70b2d3e337`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:06.679912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:06.680353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:06.681676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:06.776078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:06.777928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:06.791659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 808/1653] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:06.889730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 846/1654] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:06.894099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:06.908168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b96da1-c09b-4226-82c4-e43055f7d07e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:06.929473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:06.930208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:06.930501 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:06.935183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:06.935850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:06.942041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.019057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 809/1655] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:06 2022] POST /identity/v3/projects => generated 372 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:07.023184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:07.045256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27ff3-d8fe-41a0-b163-badb17a001ba None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:07.209055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:07.209779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.212082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.212420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.213328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:07.215370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.248024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 847/1656] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:07 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:07.252211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:07.271052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ecab51-c66d-4542-8af8-3080f90a7f6d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:07.299536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:07.305244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.306377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.306865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.309384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:07.315935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.380431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 810/1657] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:07 2022] GET /identity/v3/roles => generated 1427 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:07.380990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:07.431571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb136bf-9e95-4bf1-b273-d66554bf00fc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:07.468007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:07.469067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.469326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.469761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] PATH_INFO: `/v3/projects/4f2d23d12d254b8e9a0925194e2180c8/users/1423947d380147029ac23c6afa7621b6/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.512199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2d23d12d254b8e9a0925194e2180c8, user_id=1423947d380147029ac23c6afa7621b6, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:07.516618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.571209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 848/1658] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:07 2022] PUT /identity/v3/projects/4f2d23d12d254b8e9a0925194e2180c8/users/1423947d380147029ac23c6afa7621b6/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:07.572734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:07.581224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:07.590508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1a43-ef12-4bfa-b042-cc138c7b67de admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:07.744831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:07.748488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.748488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.748488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.748488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:07.748757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969902b8-831c-468a-9a91-dda7e8571a8a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.761319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 811/1659] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:07 2022] GET /identity/v3/roles => generated 1427 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:07.765284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:07.778677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e6678-f207-4eef-86dd-8d0fee680687 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:07.785561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:07.786486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.786781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.787065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] PATH_INFO: `/v3/projects/4f2d23d12d254b8e9a0925194e2180c8/users/1423947d380147029ac23c6afa7621b6/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.789430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f2d23d12d254b8e9a0925194e2180c8, user_id=1423947d380147029ac23c6afa7621b6, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:07.792709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:07.822728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 849/1660] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:07 2022] PUT /identity/v3/projects/4f2d23d12d254b8e9a0925194e2180c8/users/1423947d380147029ac23c6afa7621b6/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:07.837529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:07.837981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:07.838396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:07.887896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] MFA Rules not processed for user `1423947d380147029ac23c6afa7621b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:07.892323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:08.080072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 812/1661] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:08.089012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:08.091980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:08.218968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:08.228623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dda9c0-9218-460a-a137-cc91d13c3e89 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:08.236575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:08.237253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:08.237539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:08.237818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:08.257208 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:08.260232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:08.279307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 850/1662] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:08.503916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:08.505866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:08.525312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17122526-55f7-4c64-a6be-e2e444a99c27 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:08.530591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:08.531757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:08.531757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:08.531974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:08.647449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:08.649385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:08.651419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:08.655809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00bbb8-57fd-4649-be52-4df0a2866a62 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:08.698983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 813/1663] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:08.855305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab646d8-0fd1-4848-903a-aaf6d79dcdd9 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:08.872924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:08.875195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:08.875195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:08.875195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] PATH_INFO: `/v3/projects/adace30fd6d94630a8bbf637826c4cfe` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:08.876494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adace30fd6d94630a8bbf637826c4cfe)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:08.883134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:09.357915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adace30fd6d94630a8bbf637826c4cfe', 'request_id': 'req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:09.372625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adace30fd6d94630a8bbf637826c4cfe', 'request_id': 'req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:09.383114 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adace30fd6d94630a8bbf637826c4cfe', 'request_id': 'req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:09.426204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] The token cache is being invalidate because project adace30fd6d94630a8bbf637826c4cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:09.432802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:09.434155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e10a8e53-b1cd-49fd-b2c9-606cfd2f38d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:09.451582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 851/1664] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:08 2022] DELETE /identity/v3/projects/adace30fd6d94630a8bbf637826c4cfe => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:09.458114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:09.458114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:09.458314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:09.500814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:09.502259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:09.553325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:09.693806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 814/1665] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:09.702477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70094-82dd-4646-a234-e5d7037e17bc None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:09.702773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70094-82dd-4646-a234-e5d7037e17bc None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:09.703057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70094-82dd-4646-a234-e5d7037e17bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:09.745469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-20c70094-82dd-4646-a234-e5d7037e17bc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:09.752267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-20c70094-82dd-4646-a234-e5d7037e17bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:09.766045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 852/1666] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:09.770075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:09.785824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91793d65-8345-44a6-96de-51a70e9f5abd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:09.787999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:09.788294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:09.788610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:09.802917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:09.803621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:09.803915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:09.804193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:09.805651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:09.805973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:09.807685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:09.857191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 815/1667] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:09.862658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:09.874971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] MFA Rules not processed for user `e4941664ae624d4190ff53e5965db33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:09.876325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:09.886570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b3124-d7f2-4fa0-97a3-25fe28092630 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:09.894246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:09.894936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:09.895347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:09.895630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:09.896678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:09.898854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:09.973116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 816/1668] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:09 2022] POST /identity/v3/projects => generated 404 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:09.976122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.071086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 853/1669] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:10.080127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.082416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:10.090512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:10.141010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd96d-7103-43f5-896c-b1610fc74193 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.159906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:10.160800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.161202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.161594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.162418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:10.169821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:10.215751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 817/1670] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:09 2022] POST /identity/v3/users => generated 303 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:10.217790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.244079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c069b-145e-49b7-b205-ab3d9de46b5d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.251356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67f09b-7bdb-4fcd-a79e-8e73b11a917b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.260405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:10.261933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.263251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.264623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.266677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:10.271173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:10.304557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 818/1671] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:10 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:10.308019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.338576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6f024-7fed-4b34-926f-d69cdf334883 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.350250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:10.351179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.352409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:10.352409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.352628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.352911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.353345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.353766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.353868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:10.355529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:10.384154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 819/1672] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:10 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:10.388556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.410254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c705-161d-43aa-bef7-fdddfce4f896 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.423283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:10.424212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.424532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.424819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] PATH_INFO: `/v3/projects/e19762a56cd04dd39fb5d6d74183a521/users/e7fc20ca9b12474a985392d3d270e36d/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.455290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e19762a56cd04dd39fb5d6d74183a521, user_id=e7fc20ca9b12474a985392d3d270e36d, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:10.458356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae0b5-6802-4062-885c-afe57c368a6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:10.496303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 820/1673] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:10 2022] PUT /identity/v3/projects/e19762a56cd04dd39fb5d6d74183a521/users/e7fc20ca9b12474a985392d3d270e36d/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:10.496510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:10.499127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:10.499263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:10.499347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:10.499347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:10.526784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 854/1674] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:10.593334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] MFA Rules not processed for user `e7fc20ca9b12474a985392d3d270e36d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:10.595162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:10.649439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:10.784137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 821/1675] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:10.789186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:10.807996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd588-9df0-4491-b6fd-e086c07cba83 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:10.941183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:10.998573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.001038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.001347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.001632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.002362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.004495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.077875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 855/1676] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:10 2022] POST /identity/v3/projects => generated 406 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:11.079022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:11.097749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1aaa1b-69f3-4003-a149-7c28a0382df8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:11.300766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.303575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.303984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.308101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.313574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.320648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.374274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 822/1677] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:11 2022] POST /identity/v3/users => generated 310 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:11.378401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:11.391880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176a80b-a06c-4cd6-888e-9188a7fd8979 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:11.424146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.428041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.429014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.429014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.429726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.432172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.466546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 856/1678] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:11 2022] GET /identity/v3/roles => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:11.470521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:11.484467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e7cd-2982-4b70-aa70-beaf5270845a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:11.496320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.497597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.497947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.498805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] PATH_INFO: `/v3/projects/e880619ce7a54fe4bc10a1391f435a9a/users/95875ed6a886447eaef4ef6c5af8dc00/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.594315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e880619ce7a54fe4bc10a1391f435a9a, user_id=95875ed6a886447eaef4ef6c5af8dc00, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.598925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.657519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 823/1679] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:11 2022] PUT /identity/v3/projects/e880619ce7a54fe4bc10a1391f435a9a/users/95875ed6a886447eaef4ef6c5af8dc00/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:11.662528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:11.683319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd2cbe-44d2-4e46-a21d-a38d389307cf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:11.836032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.836982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.837274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.843307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.844163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.845852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1bccc-cee4-4049-ab68-d02edc074012 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.865331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 857/1680] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:11 2022] GET /identity/v3/roles => generated 1427 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:11.866451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:11.896032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788cf52-e131-433e-8deb-2de088bff015 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:11.926777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:11.932672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.935859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.936961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] PATH_INFO: `/v3/projects/e880619ce7a54fe4bc10a1391f435a9a/users/95875ed6a886447eaef4ef6c5af8dc00/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:11.941899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e880619ce7a54fe4bc10a1391f435a9a, user_id=95875ed6a886447eaef4ef6c5af8dc00, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:11.957298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:11.995761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b0bc-8373-490c-ab23-ed8fa71d75e4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:11.996064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b0bc-8373-490c-ab23-ed8fa71d75e4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:11.996356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2b0bc-8373-490c-ab23-ed8fa71d75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:12.006219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 824/1681] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:11 2022] PUT /identity/v3/projects/e880619ce7a54fe4bc10a1391f435a9a/users/95875ed6a886447eaef4ef6c5af8dc00/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:12.090370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-85a2b0bc-8373-490c-ab23-ed8fa71d75e4 None None] MFA Rules not processed for user `95875ed6a886447eaef4ef6c5af8dc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:12.092258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-85a2b0bc-8373-490c-ab23-ed8fa71d75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:12.269052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 858/1682] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:11 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:12.275414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:12.277369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:12.423444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32348c01-a513-4219-9227-5d38576a2f7d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:12.435268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:12.444218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:12.444713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:12.445127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:12.489981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:12.491461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:12.517863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 825/1683] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:12.613355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077be-467a-4c1b-a8f8-70a67fed50fb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:12.614569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077be-467a-4c1b-a8f8-70a67fed50fb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:12.615127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e077be-467a-4c1b-a8f8-70a67fed50fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:12.697718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a0e077be-467a-4c1b-a8f8-70a67fed50fb None None] MFA Rules not processed for user `9330e65e73394f18b87c5b1d5d47f564`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:12.699057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a0e077be-467a-4c1b-a8f8-70a67fed50fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:12.785679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:12.897938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:12.934015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:12.958015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 859/1684] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:12.959566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907733-fbef-4072-80f5-7e00a457d6bf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:12.959864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907733-fbef-4072-80f5-7e00a457d6bf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:12.960191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a907733-fbef-4072-80f5-7e00a457d6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.006588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0a907733-fbef-4072-80f5-7e00a457d6bf None None] MFA Rules not processed for user `9330e65e73394f18b87c5b1d5d47f564`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:13.007900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0a907733-fbef-4072-80f5-7e00a457d6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.034370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef87fc-8b40-4674-be31-2f99610b9756 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:13.041357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:13.042389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.042949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.043462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] PATH_INFO: `/v3/users/e7fc20ca9b12474a985392d3d270e36d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.045008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fc20ca9b12474a985392d3d270e36d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:13.046231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 860/1685] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:13.047924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:13.058918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b729-ecae-4e17-8157-319cbbe0f278 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.059250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b729-ecae-4e17-8157-319cbbe0f278 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.059561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145b729-ecae-4e17-8157-319cbbe0f278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.116335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5145b729-ecae-4e17-8157-319cbbe0f278 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:13.125071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5145b729-ecae-4e17-8157-319cbbe0f278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.147160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fc20ca9b12474a985392d3d270e36d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:13.147953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fc20ca9b12474a985392d3d270e36d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:13.166356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fc20ca9b12474a985392d3d270e36d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:13.176961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fc20ca9b12474a985392d3d270e36d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:13.200298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fc20ca9b12474a985392d3d270e36d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:13.226696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 826/1686] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:12 2022] DELETE /identity/v3/users/e7fc20ca9b12474a985392d3d270e36d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:13.229716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:13.236697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.306327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 861/1687] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:13.311388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.311388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.311388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.368340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:13.379285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.474231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017a2a-c142-441a-a982-4c15916f5f74 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:13.486480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:13.487160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.487458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.487743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.493467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.578113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 862/1688] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:13.599263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:13.602541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.660246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:13.767616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:13.768999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:13.805534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 827/1689] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:13.806669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:13.811421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c381449-5e3d-465b-9a0b-9c941fad4b2c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:13.813881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:13.828830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:13.829559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.829858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.830858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:13.863672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:13.870164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:13.907636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 863/1690] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:13.985442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871cc95-5aa4-4627-916d-f4896c4e45f0 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:13.991863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:13.992774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:13.993206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:13.993625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:14.067547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:14.069581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf0b7d-ed6b-499a-8973-6718eaca8731 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:14.080642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 828/1691] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:41:15.396017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:15.397577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:15.411471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:15.419920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea2521-aa51-47cf-a5ec-fedc91077db3 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:15.461580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:15.462592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:15.462782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:15.463040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] PATH_INFO: `/v3/projects/e19762a56cd04dd39fb5d6d74183a521` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:15.466476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e19762a56cd04dd39fb5d6d74183a521)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:15.468563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:15.612242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e19762a56cd04dd39fb5d6d74183a521', 'request_id': 'req-1de936fa-7a1a-47eb-b32c-1b10a357adb9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:15.619820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea980-2e2d-4722-b2c2-9f51f25bd410 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:15.621414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea980-2e2d-4722-b2c2-9f51f25bd410 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:15.621992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bea980-2e2d-4722-b2c2-9f51f25bd410 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:15.625237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 829/1692] 10.222.0.102 () {54 vars in 917 bytes} [Thu May 26 16:41:15 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:15.626225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e19762a56cd04dd39fb5d6d74183a521', 'request_id': 'req-1de936fa-7a1a-47eb-b32c-1b10a357adb9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:15.631332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:15.631857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:15.632393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:15.644573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e19762a56cd04dd39fb5d6d74183a521', 'request_id': 'req-1de936fa-7a1a-47eb-b32c-1b10a357adb9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:15.675045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] The token cache is being invalidate because project e19762a56cd04dd39fb5d6d74183a521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:15.675592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:15.676361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:15.676647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:15.679352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 864/1693] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:15 2022] DELETE /identity/v3/projects/e19762a56cd04dd39fb5d6d74183a521 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:15.681497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:15.683790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:15.689458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:15.820692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 830/1694] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:41:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:15.845893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de936fa-7a1a-47eb-b32c-1b10a357adb9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:15.852810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:15.853824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:15.854128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:15.854429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] PATH_INFO: `/v3/users/95875ed6a886447eaef4ef6c5af8dc00` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:15.857591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95875ed6a886447eaef4ef6c5af8dc00)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:15.857591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: WARNING py.warnings [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 16:41:15.857591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: warnings.warn(msg) May 26 16:41:15.857591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: May 26 16:41:15.858374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:15.907301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:15.910616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:15.978290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e82f6-bddd-49ee-b873-7ea30a2c4f91 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:16.016288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:16.020388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:16.031737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:16.036686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:16.056064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95875ed6a886447eaef4ef6c5af8dc00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:16.088408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:16.099464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb06fee-4a95-4fe9-b884-d508e58e9950 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:16.115687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 831/1695] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:16.151223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95875ed6a886447eaef4ef6c5af8dc00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:16.184014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95875ed6a886447eaef4ef6c5af8dc00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:16.185067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95875ed6a886447eaef4ef6c5af8dc00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:16.185774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6c8f0bf4-7a79-4be2-adf1-abfb4ca714e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95875ed6a886447eaef4ef6c5af8dc00'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:16.269837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 865/1696] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:15 2022] DELETE /identity/v3/users/95875ed6a886447eaef4ef6c5af8dc00 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:17.062958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:17.063645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:17.063645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:17.114681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] MFA Rules not processed for user `e4941664ae624d4190ff53e5965db33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:17.117172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:17.127027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:17.233903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099641e-079f-4d37-ac9c-d8e25a7175db None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:17.234490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099641e-079f-4d37-ac9c-d8e25a7175db None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:17.234490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e099641e-079f-4d37-ac9c-d8e25a7175db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:17.253266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:17.293583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 832/1697] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:17.295603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:17.312305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e099641e-079f-4d37-ac9c-d8e25a7175db None None] MFA Rules not processed for user `2e5e1735e7f54f2d8943a0f55311394b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:17.313273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:17.315709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e099641e-079f-4d37-ac9c-d8e25a7175db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:17.507731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db0ba2-e5b3-4693-89e4-2a0addbb1860 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:17.527925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 866/1698] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:17.531546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:17.532611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:17.532976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:17.533332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] PATH_INFO: `/v3/projects/e880619ce7a54fe4bc10a1391f435a9a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:17.538773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e880619ce7a54fe4bc10a1391f435a9a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:17.543134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:17.639646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e880619ce7a54fe4bc10a1391f435a9a', 'request_id': 'req-9005ec6c-155e-46c8-92f1-fc1f7367364a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:17.649836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e880619ce7a54fe4bc10a1391f435a9a', 'request_id': 'req-9005ec6c-155e-46c8-92f1-fc1f7367364a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:17.662727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e880619ce7a54fe4bc10a1391f435a9a', 'request_id': 'req-9005ec6c-155e-46c8-92f1-fc1f7367364a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:17.680498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] The token cache is being invalidate because project e880619ce7a54fe4bc10a1391f435a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:17.681091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:17.681971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9005ec6c-155e-46c8-92f1-fc1f7367364a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:17.690045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8791-c90f-4e68-8502-5e2bb6ea6804 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:17.690658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8791-c90f-4e68-8502-5e2bb6ea6804 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:17.691127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c8791-c90f-4e68-8502-5e2bb6ea6804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:17.693347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 833/1699] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:17 2022] DELETE /identity/v3/projects/e880619ce7a54fe4bc10a1391f435a9a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:17.730363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b41c8791-c90f-4e68-8502-5e2bb6ea6804 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:17.735261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b41c8791-c90f-4e68-8502-5e2bb6ea6804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:18.018284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.018757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.019234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.022399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 867/1700] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:18.092571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.092974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.093354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.134517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:18.136770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:18.152613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] MFA Rules not processed for user `9330e65e73394f18b87c5b1d5d47f564`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:18.154721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:18.174358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 834/1701] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:18.175268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:18.180659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:18.379284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:18.413092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 868/1702] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:18.413949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:18.463889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d855-a952-4764-8580-7d8ac6d4741d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:18.472982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:18.477359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.477359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.477359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.479125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:18.479488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:18.481429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:18.486309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025467b-d75e-4805-ac5e-b8d45aaebfaa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:18.506673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:18.508392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.513261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.513561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.518278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:18.562341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 869/1703] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:18.565826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:18.597568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771f262-461b-4085-b629-7fd0f5f14934 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:18.604781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:18.606782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:18.616587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:18.617195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.618026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.618311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.619184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:18.625271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:18.627588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 835/1704] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:18.694720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 870/1705] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:18 2022] POST /identity/v3/projects => generated 406 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:18.699915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:18.724340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c819-538d-43ce-9c44-296f9a39bd0f service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:18.931230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:18.931934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:18.932223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:18.932771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:18.933291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:18.935299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:18.987754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 836/1706] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:18 2022] POST /identity/v3/users => generated 304 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:18.991704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:19.002788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd6c15-d374-4df4-8716-86806f1bfeb4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:19.028038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:19.028715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:19.029219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:19.029677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:19.033085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:19.034730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:19.036305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:19.053172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 871/1707] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:18 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:19.053696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:19.071588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ce05b-9dec-4a31-8d00-117d313ed074 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:19.083001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:19.083691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:19.083979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:19.084256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:19.085040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:19.086792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee3b5a-c9fa-4bd9-ab16-47d63799d7a5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:19.131440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 837/1708] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:19 2022] GET /identity/v3/roles => generated 1427 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:19.132054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:19.155779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910cf1da-a3b1-4e15-968b-2963a4d109fc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:19.173213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:19.174276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:19.174563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:19.174856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] PATH_INFO: `/v3/projects/9280950d88fe497ca6505f2be1ffc693/users/25d059469d464f489d46b6c7584335aa/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:19.221133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9280950d88fe497ca6505f2be1ffc693, user_id=25d059469d464f489d46b6c7584335aa, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:19.231338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:19.352743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 872/1709] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:19 2022] PUT /identity/v3/projects/9280950d88fe497ca6505f2be1ffc693/users/25d059469d464f489d46b6c7584335aa/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:19.355380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d4d3-59b3-42b6-a422-1e7766adb42f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:19.355906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d4d3-59b3-42b6-a422-1e7766adb42f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:19.356055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d4d3-59b3-42b6-a422-1e7766adb42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:19.479415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-61b0d4d3-59b3-42b6-a422-1e7766adb42f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:19.486236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61b0d4d3-59b3-42b6-a422-1e7766adb42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:19.693593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:19.727743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 838/1710] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:19.739538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:19.742745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:19.942287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73302d-a5b5-40b4-84ba-1b630f4c4f5e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:19.954376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:19.955068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:19.955359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:19.955644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:19.993391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:19.994888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:20.028472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 873/1711] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:21.469376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:21.470476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:21.471024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:21.509605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:21.511477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:21.551179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 839/1712] 10.222.0.47 () {58 vars in 1019 bytes} [Thu May 26 16:41:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:22.139180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:22.141812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:22.163216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c243126-264d-4f72-b6a9-960c32ca1abd service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:22.174513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:22.175572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:22.178771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:22.179284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:22.206664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:22.208747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e08a2-ad76-4e1c-9a03-1e125a77dd13 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:22.232081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 874/1713] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:24.038299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:24.041178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:24.088211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248cf52-1cba-482f-99d0-f6c81066f696 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:24.097343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:24.098298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:24.098589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:24.098871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] PATH_INFO: `/v3/users/602566fb23bc463c834d92cdc035fbd7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:24.100327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=602566fb23bc463c834d92cdc035fbd7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:24.102458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:24.150586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:24.151524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:24.152000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:24.220293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '602566fb23bc463c834d92cdc035fbd7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:24.222818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] MFA Rules not processed for user `25d059469d464f489d46b6c7584335aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:24.223059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '602566fb23bc463c834d92cdc035fbd7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:24.224415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:24.257102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '602566fb23bc463c834d92cdc035fbd7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:24.276229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '602566fb23bc463c834d92cdc035fbd7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:24.311803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ef8dfaa6-f024-4d27-a69d-d1c70c4f4898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '602566fb23bc463c834d92cdc035fbd7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:24.342460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 840/1714] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:24 2022] DELETE /identity/v3/users/602566fb23bc463c834d92cdc035fbd7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:24.344227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:24.344643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:24.344884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:24.424099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:24.425169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:24.620639 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 875/1715] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:24.628266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:24.637668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:24.724954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e523b5c-9166-48f3-bac2-0445da27ca7c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:24.848641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 841/1716] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:24.916304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:24.932158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:24.933649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:24.954953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:24.955846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:24.956630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:24.956929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:24.957674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:24.975663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.050283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 876/1717] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:24 2022] POST /identity/v3/projects => generated 400 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:25.054529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:25.254300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd7ac-3574-4d6c-bff3-7a688485470e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:25.296096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:25.355237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa20e59-1875-4322-95b1-71c518689f65 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:25.373992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:25.375348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.375782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.376250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.377244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:25.380337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b4ec2-125d-4bc0-b628-82b5df80aa7a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.406423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:25.410297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.410923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.412237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.446322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:25.452642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.462259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 877/1718] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:25 2022] POST /identity/v3/users => generated 307 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:25.463869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.464165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.464473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.485790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 842/1719] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:25.490061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:25.517983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece7c98-5c20-4c87-833f-8c148ee76345 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:25.533864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:25.534822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.536440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.536980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.538239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:25.545389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.575834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] MFA Rules not processed for user `2e5e1735e7f54f2d8943a0f55311394b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:25.577095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:25.583397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 843/1720] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:25.584721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:25.594995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:25.638334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcce54-168c-4638-95aa-15dd86e6d6f0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:25.667593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:25.668692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.670575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.671132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] PATH_INFO: `/v3/users/a10274a364b34cc689aba9e2e6b0c113` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.683764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10274a364b34cc689aba9e2e6b0c113)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:25.693796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.804467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 878/1721] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:25.805908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:25.857932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169310ee-27da-4bf8-ac34-11c6d9bab8fd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:25.863438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:25.864747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:25.865199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:25.865610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] PATH_INFO: `/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a/users/db9e573a023e4db3a20fcfc40c1f49b5/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:25.884998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10274a364b34cc689aba9e2e6b0c113'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:25.887682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10274a364b34cc689aba9e2e6b0c113'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:25.914155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3c02a6a82c4ab2acab41ff46067f2a, user_id=db9e573a023e4db3a20fcfc40c1f49b5, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:25.925702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:25.941529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10274a364b34cc689aba9e2e6b0c113'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:25.968163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10274a364b34cc689aba9e2e6b0c113'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:25.970510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 879/1722] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:25 2022] PUT /identity/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a/users/db9e573a023e4db3a20fcfc40c1f49b5/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:25.971225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:25.991980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e4a6e4bc-caf8-4514-8743-c2ab43785f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10274a364b34cc689aba9e2e6b0c113'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:26.007953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 844/1723] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:25 2022] DELETE /identity/v3/users/a10274a364b34cc689aba9e2e6b0c113 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:26.011931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:26.012479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:26.012930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:26.075993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:26.081679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:26.097144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:26.132591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af127a7-224d-4a68-8427-e7a8408c2371 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:26.230771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:26.234209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:26.234637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:26.234936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:26.236543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:26.242001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:26.246241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 845/1724] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:26.288519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 880/1725] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:25 2022] GET /identity/v3/roles => generated 1427 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:26.294110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:26.296943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:26.315843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057a85b-1f8f-4478-8362-f3b4d3c26a42 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:26.329345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:26.330724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:26.331233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:26.331728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] PATH_INFO: `/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a/users/db9e573a023e4db3a20fcfc40c1f49b5/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:26.334584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3c02a6a82c4ab2acab41ff46067f2a, user_id=db9e573a023e4db3a20fcfc40c1f49b5, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:26.338848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:26.376062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 846/1726] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:26 2022] PUT /identity/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a/users/db9e573a023e4db3a20fcfc40c1f49b5/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:26.529124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:26.532958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:26.703841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833603d2-5882-4e05-8e18-f9e09e909406 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:26.893548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:26.894438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:26.894736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:26.895021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:26.958893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:26.962626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:26.993952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:27.082557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:27.086687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:27.091426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec75bb-eec1-49df-91e4-476746fdc6df service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:27.126193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 881/1727] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:27.250170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e06da-5f1e-4695-ae96-01af3e3c44b6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:27.260208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:27.261919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:27.262427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:27.262936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] PATH_INFO: `/v3/projects/f7449f3a96c8444a8efdb118290cc4e0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:27.264672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7449f3a96c8444a8efdb118290cc4e0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:27.267069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:27.405610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7449f3a96c8444a8efdb118290cc4e0', 'request_id': 'req-1476f775-40aa-4b31-8403-aef23fd95f5a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:27.422376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7449f3a96c8444a8efdb118290cc4e0', 'request_id': 'req-1476f775-40aa-4b31-8403-aef23fd95f5a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:27.452054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7449f3a96c8444a8efdb118290cc4e0', 'request_id': 'req-1476f775-40aa-4b31-8403-aef23fd95f5a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:27.490063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] The token cache is being invalidate because project f7449f3a96c8444a8efdb118290cc4e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:27.490691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:27.494030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1476f775-40aa-4b31-8403-aef23fd95f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:27.506121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 847/1728] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:26 2022] DELETE /identity/v3/projects/f7449f3a96c8444a8efdb118290cc4e0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:27.508354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:27.509332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:27.510099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:27.602686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:27.608745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:27.750924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 882/1729] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:27.760716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:27.761188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:27.761691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:27.827666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:27.830529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:27.875215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 848/1730] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:27.879752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:27.904583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d579bff-055f-444f-9a1f-2ca9a713806f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:27.921360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:27.922580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:27.923007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:27.924846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:27.927693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:27.928014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:27.936066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:27.970813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 883/1731] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:27.975264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:27.996103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e151bd3-1a3b-4dc5-8a9b-86374592c540 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:28.011811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:28.013838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.017063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.017396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.018525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:28.023572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:28.103235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 849/1732] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:27 2022] POST /identity/v3/projects => generated 370 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:28.104231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:28.119775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5e1d8-77e0-4b3f-a300-8bc2087fe66f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:28.300449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:28.301386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.301692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.301980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.306999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:28.311715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:28.389063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 884/1733] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:28 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:28.392554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:28.430785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4480a89b-4085-46c6-90ca-ba79fe477510 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:28.457836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:28.459412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.459527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.459748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.460546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:28.462243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:28.521981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:28.536868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16646247-5d22-4592-b5bd-7c4c55f0f6eb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:28.538391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 850/1734] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:28 2022] GET /identity/v3/roles => generated 1427 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:28.562819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:28.568123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.568123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.568123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.568123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:28.568657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4297ea-6c75-42fa-ba6d-398feacdb35a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:28.650446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 885/1735] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:28 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:28.654650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:28.689182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b575411-996d-49f1-bff1-5ddfe79db327 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:28.739213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:28.740253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.746999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.747409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] PATH_INFO: `/v3/projects/8bd590f899dd4707ab21c2e0b9764d50/users/ee8dae55859f4d54848fa017d522518b/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.816505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd590f899dd4707ab21c2e0b9764d50, user_id=ee8dae55859f4d54848fa017d522518b, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:28.819830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:28.848090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 851/1736] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:28 2022] PUT /identity/v3/projects/8bd590f899dd4707ab21c2e0b9764d50/users/ee8dae55859f4d54848fa017d522518b/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:28.859065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:28.859418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:28.859717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:28.955553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] MFA Rules not processed for user `ee8dae55859f4d54848fa017d522518b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:28.960324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:29.162608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:29.218124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:29.226293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 886/1737] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:29.361447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:29.419778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9475fc-cfce-493c-a4d8-78cb123abe84 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:29.438048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:29.439132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:29.448328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:29.449318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:29.452915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:29.458122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:29.551262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:29.553314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 852/1738] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:29 2022] POST /identity/v3/projects => generated 370 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:29.573777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724b79b-918a-45b1-b007-e7fd8cf63b8b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:29.714389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:29.717244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:29.771173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:29.774332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:29.776492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:29.776822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:29.780864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:29.792920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:29.870181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 887/1739] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:29 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:29.872601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:29.897614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2f84b7-103d-4965-94f2-17143bc8133c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:29.913262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:29.914220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:29.916403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:29.916902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:29.917912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:29.924067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:29.957012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 888/1740] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:29 2022] GET /identity/v3/roles => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:29.959615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b779114-5a12-420d-8eda-31096e05b4aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:29.960774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:29.974895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:29.975946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:29.976346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:29.978308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] PATH_INFO: `/v3/projects/92f59916468749d7b3f0a41b9ede29b3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:29.981104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] RBAC: Authorizing `identity:delete_project(project_id=92f59916468749d7b3f0a41b9ede29b3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:29.983295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:29.986699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c98b5-4820-44ad-8162-17e24a35ab1a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.004562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.005650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.006168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.006669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] PATH_INFO: `/v3/projects/71d365e1d0534ef9add95c9515d6cbdc/users/f701b349ab024bb6a6be815f5e4fff92/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.035232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d365e1d0534ef9add95c9515d6cbdc, user_id=f701b349ab024bb6a6be815f5e4fff92, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:30.038434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:30.063824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 889/1741] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:29 2022] PUT /identity/v3/projects/71d365e1d0534ef9add95c9515d6cbdc/users/f701b349ab024bb6a6be815f5e4fff92/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:30.069024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.121926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92f59916468749d7b3f0a41b9ede29b3', 'request_id': 'req-8bb75e78-b9f6-49d3-b973-82d8c553718e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:30.145136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92f59916468749d7b3f0a41b9ede29b3', 'request_id': 'req-8bb75e78-b9f6-49d3-b973-82d8c553718e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:30.163055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92f59916468749d7b3f0a41b9ede29b3', 'request_id': 'req-8bb75e78-b9f6-49d3-b973-82d8c553718e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:30.199945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] The token cache is being invalidate because project 92f59916468749d7b3f0a41b9ede29b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:30.200409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:30.201584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8bb75e78-b9f6-49d3-b973-82d8c553718e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:30.213918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 853/1742] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:29 2022] DELETE /identity/v3/projects/92f59916468749d7b3f0a41b9ede29b3 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:30.215960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cd86-98a4-4f44-9dfe-df8ea41fa81f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.216608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cd86-98a4-4f44-9dfe-df8ea41fa81f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.217087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5747cd86-98a4-4f44-9dfe-df8ea41fa81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.269689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5747cd86-98a4-4f44-9dfe-df8ea41fa81f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:30.271145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5747cd86-98a4-4f44-9dfe-df8ea41fa81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:30.272545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618ce5b-4b3c-43f3-bb7b-1f69e2d6a3be admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.356233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:30.368601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:30.378409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.381342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.381342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.381969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.383214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:30.386897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:30.410230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 890/1743] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:30 2022] GET /identity/v3/roles => generated 1427 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:30.415679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.423621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 854/1744] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:30.423950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:30.427731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.428032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.428406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.446661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4122f73-36f5-48b0-be3f-b41f44627695 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.456343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.458906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:30.459451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.459451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.459451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] PATH_INFO: `/v3/projects/71d365e1d0534ef9add95c9515d6cbdc/users/f701b349ab024bb6a6be815f5e4fff92/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.461927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:30.465957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d365e1d0534ef9add95c9515d6cbdc, user_id=f701b349ab024bb6a6be815f5e4fff92, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:30.471740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 855/1745] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:30.472924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e7ccfe-a2dd-4519-bf89-9995843ff0af admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:30.475637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.488605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8536d2e-6480-4767-b5d8-f62a7fcf30d4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.489161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 891/1746] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:30 2022] PUT /identity/v3/projects/71d365e1d0534ef9add95c9515d6cbdc/users/f701b349ab024bb6a6be815f5e4fff92/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:30.500057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b84cf1-8aee-4de0-bcc7-59c49fcfea3c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.500707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b84cf1-8aee-4de0-bcc7-59c49fcfea3c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.501109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b84cf1-8aee-4de0-bcc7-59c49fcfea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.563349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a4b84cf1-8aee-4de0-bcc7-59c49fcfea3c None None] MFA Rules not processed for user `f701b349ab024bb6a6be815f5e4fff92`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:30.566084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a4b84cf1-8aee-4de0-bcc7-59c49fcfea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:30.689422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 892/1747] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:30.690224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.691403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.691608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.691843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.691939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.692184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.692999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.694067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:30.694520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:30.694717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 893/1748] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:41:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:30.697729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:30.702038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.708650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:30.714772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 856/1749] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:30.721047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.733330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d87e71-d4ee-4147-860e-a3e981baa29b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.739499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.740819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.741404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.741997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.743370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:30.768080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d04bf8-0f43-4807-951c-039469b9f4da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:30.839912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 857/1750] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:30 2022] POST /identity/v3/projects => generated 356 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:30.841850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae8b9-2010-458b-83f7-9e9797ff685b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.842317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae8b9-2010-458b-83f7-9e9797ff685b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.842862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ae8b9-2010-458b-83f7-9e9797ff685b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:30.845919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 858/1751] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:41:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:30.848651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8260f34-ebb8-4c34-8829-699a44372e66 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:30.849313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ae8b9-2010-458b-83f7-9e9797ff685b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:30.938183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:30.939633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:30.940151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:30.940955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.007410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ae8b9-2010-458b-83f7-9e9797ff685b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.013331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.018227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.018991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.019902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.020196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.021074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.023178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399663d-76bd-491b-a9dc-2d62c0d4cd1a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.064011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 859/1752] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:30 2022] POST /identity/v3/users => generated 279 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:31.065919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.066440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.066816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.112967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:31.114320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.129250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.134291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b26ea-c4d2-48ac-9c38-60fc14d6848f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.158050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 894/1753] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:31.170667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.174740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.175345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.193960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.218679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:31.219992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.246680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 860/1754] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:31.254725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.279870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5803e4-b85b-4165-946f-058ecdb9f3d8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.286651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.288055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.288382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.288841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.290687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.299714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.316122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 861/1755] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:31 2022] GET /identity/v3/roles => generated 1427 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:31.317169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.321910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.340180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572948d2-cb0a-41d4-b778-c12712e002b5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.347090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.347774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.348066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.348352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.350456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.372777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 895/1756] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:31.373800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.388073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c93c1-1344-40a8-9e45-6a89af815766 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.394155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.395656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.396073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.396505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.397767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.400095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b921b-989d-428b-8fb0-30c0443e4cea admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.419058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 896/1757] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:31 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:31.421718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.422159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.422623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.473412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] MFA Rules not processed for user `db9e573a023e4db3a20fcfc40c1f49b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:31.475606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.511122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.513815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.537610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 862/1758] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:31.539019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.542239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.607389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3980257-f7be-4a47-83bf-5987d7a8fd60 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.628010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.628838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.629232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.629413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.640781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 897/1759] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:31.642510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.661172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.662684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc702a-9535-4d93-ba44-2a83b602576b service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.670541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad794afb-2536-4559-aa30-78f9390a761b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:31.680882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:31.682516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.682811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.683092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] PATH_INFO: `/v3/projects/1f5d6439c00b4d2eb7793ac383b5146e/users/80a9f2886865441693ee95403bbde99e/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.704746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 863/1760] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:31.725837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5d6439c00b4d2eb7793ac383b5146e, user_id=80a9f2886865441693ee95403bbde99e, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:31.732243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:31.758177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 898/1761] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:31 2022] PUT /identity/v3/projects/1f5d6439c00b4d2eb7793ac383b5146e/users/80a9f2886865441693ee95403bbde99e/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:31.769504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:31.769803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:31.770259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:31.846038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] MFA Rules not processed for user `80a9f2886865441693ee95403bbde99e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:31.847561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.860925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:31.863164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:31.890296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:31.983657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 864/1762] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:31.990872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:32.101996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead6d86-8591-4248-8dc6-cdba26d08893 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.103770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.104501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.105424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.105424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.160833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.167442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:32.192213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:32.202305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 899/1763] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:32.267841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330db55c-98ea-49d8-889c-b663ce91a792 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.280198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.281317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.281317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.281603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.282529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.284212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:32.344965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 865/1764] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:31 2022] POST /identity/v3/projects => generated 358 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:32.349031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:32.362721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975677-e33a-4ec7-866e-5ccbe7769f63 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.492363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.494195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.494687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.495158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.496083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.501518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:32.560402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 900/1765] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:32 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:32.561127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:32.589832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2a28a-80ca-4e81-a81c-d79576d2cac0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.600546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.601430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.601908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.602366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.603894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.614602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:32.641189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:32.645336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 866/1766] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:32 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:32.654403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c3420-f5c7-4d32-b987-71959fcd40d3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.673052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.674244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.674537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.674815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] PATH_INFO: `/v3/projects/011000aa6bba4df59d3b11caef1b6e10/users/f81353a34b6b438a87cb1052e9d06ff4/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.724994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] RBAC: Authorizing `identity:create_grant(project_id=011000aa6bba4df59d3b11caef1b6e10, user_id=f81353a34b6b438a87cb1052e9d06ff4, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.735074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:32.775281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 901/1767] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:32 2022] PUT /identity/v3/projects/011000aa6bba4df59d3b11caef1b6e10/users/f81353a34b6b438a87cb1052e9d06ff4/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:32.777360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:32.809963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c74d35-6148-410d-92ba-6e72e81fed6a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:32.984409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:32.985910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:32.985910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:32.985910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:32.987011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:32.989049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16292c0-615b-465f-bba2-0a697a932568 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:33.008798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 867/1768] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:32 2022] GET /identity/v3/roles => generated 1427 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:33.010224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:33.024869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff949-52d5-4f99-ae19-c3f4a12b322d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:33.031336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:33.032653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.033131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.033591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] PATH_INFO: `/v3/projects/011000aa6bba4df59d3b11caef1b6e10/users/f81353a34b6b438a87cb1052e9d06ff4/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.036925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011000aa6bba4df59d3b11caef1b6e10, user_id=f81353a34b6b438a87cb1052e9d06ff4, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:33.040670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:33.055657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 902/1769] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:33 2022] PUT /identity/v3/projects/011000aa6bba4df59d3b11caef1b6e10/users/f81353a34b6b438a87cb1052e9d06ff4/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:33.066838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194dd0-de71-4b5f-8a05-e2632606b033 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.067081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194dd0-de71-4b5f-8a05-e2632606b033 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.067414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75194dd0-de71-4b5f-8a05-e2632606b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.112585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-75194dd0-de71-4b5f-8a05-e2632606b033 None None] MFA Rules not processed for user `f81353a34b6b438a87cb1052e9d06ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:33.114081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-75194dd0-de71-4b5f-8a05-e2632606b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:33.234409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 868/1770] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:33.246942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:33.337860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:33.343641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afd8f-b584-454f-9253-1b55d386ed33 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:33.348636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:33.349312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.349606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.350098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.362156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:33.363626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187bca6-bbaa-4a23-9ba0-a690860f3956 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:33.376755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 903/1771] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:33.478453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c670e2-7081-458a-89e2-b5a2cbd1306d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.479076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c670e2-7081-458a-89e2-b5a2cbd1306d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.479546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c670e2-7081-458a-89e2-b5a2cbd1306d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.481782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 869/1772] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:41:33 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:33.504677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.505226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.505722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.538263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:33.540727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:33.542787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c670e2-7081-458a-89e2-b5a2cbd1306d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:33.558068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c670e2-7081-458a-89e2-b5a2cbd1306d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:33.566832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:33.568470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.568933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.569422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.649954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:33.707451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 904/1773] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:41:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:33.716839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:33.718669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:33.733213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 870/1774] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:33.775798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:33.777552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:33.808120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7714dad-12bf-4d1a-9f30-726ce66c8b32 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:33.816452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:33.817436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:33.817905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:33.818478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:33.843647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:33.847091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b79bf-d054-4caf-8a2a-470b56edccd5 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:33.868791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 905/1775] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:36.273496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:36.566947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcdbee-c099-4f04-9680-47c5015d668c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:36.579207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:36.580822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:36.581322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:36.582173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] PATH_INFO: `/v3/users/ee8dae55859f4d54848fa017d522518b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:36.584412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8dae55859f4d54848fa017d522518b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:36.588674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:36.742732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8dae55859f4d54848fa017d522518b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:36.743881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8dae55859f4d54848fa017d522518b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:36.785752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8dae55859f4d54848fa017d522518b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:36.813728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8dae55859f4d54848fa017d522518b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:36.833352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8dae55859f4d54848fa017d522518b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:36.845044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 871/1776] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:36 2022] DELETE /identity/v3/users/ee8dae55859f4d54848fa017d522518b => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:36.850508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:36.852011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:36.852847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:36.931531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:36.933659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:36.959813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:36.963578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:37.125211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:37.141171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eb8a4-dd50-4d26-b5fa-66d5d4fe8b97 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:37.149377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:37.150906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.151459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.152171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] PATH_INFO: `/v3/users/25d059469d464f489d46b6c7584335aa` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.154313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d059469d464f489d46b6c7584335aa)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:37.157433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:37.165641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 906/1777] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:37.175089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:37.176917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:37.270682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d88a-f8f6-4bc7-ada6-a0ba6550f1e9 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:37.280577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:37.281581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:37.282031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:37.284152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:37.302398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:37.303456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:37.345899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d059469d464f489d46b6c7584335aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:37.348162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d059469d464f489d46b6c7584335aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:37.382545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 907/1778] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:37.438840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d059469d464f489d46b6c7584335aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:37.465505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d059469d464f489d46b6c7584335aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:37.497910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d059469d464f489d46b6c7584335aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:37.530319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 872/1779] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:36 2022] DELETE /identity/v3/users/25d059469d464f489d46b6c7584335aa => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:37.869723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:37.870498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:37.872603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:37.873800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:37.903644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc810b6b-1ed2-4468-89fd-98c24a148af7 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:37.925371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:38.011912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:38.013673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:38.013673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:38.013937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] PATH_INFO: `/v3/projects/8bd590f899dd4707ab21c2e0b9764d50` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:38.015211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd590f899dd4707ab21c2e0b9764d50)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:38.018849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:38.035978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908c8cf-1255-4eb3-996a-4eb648126d3c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:38.043274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:38.044854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:38.045386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:38.046149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] PATH_INFO: `/v3/projects/9280950d88fe497ca6505f2be1ffc693` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:38.050815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9280950d88fe497ca6505f2be1ffc693)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:38.053070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:38.123089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd590f899dd4707ab21c2e0b9764d50', 'request_id': 'req-bc9e654a-f5a5-4902-9e25-c106a6bf203a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.137088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd590f899dd4707ab21c2e0b9764d50', 'request_id': 'req-bc9e654a-f5a5-4902-9e25-c106a6bf203a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.147081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd590f899dd4707ab21c2e0b9764d50', 'request_id': 'req-bc9e654a-f5a5-4902-9e25-c106a6bf203a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.152206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9280950d88fe497ca6505f2be1ffc693', 'request_id': 'req-239729eb-abed-4d0a-ac95-377fd3469611'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.164985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] The token cache is being invalidate because project 8bd590f899dd4707ab21c2e0b9764d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:38.165319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.166021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.167643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 908/1780] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:37 2022] DELETE /identity/v3/projects/8bd590f899dd4707ab21c2e0b9764d50 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:38.173724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:38.173896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9280950d88fe497ca6505f2be1ffc693', 'request_id': 'req-239729eb-abed-4d0a-ac95-377fd3469611'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.175668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:38.189783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9280950d88fe497ca6505f2be1ffc693', 'request_id': 'req-239729eb-abed-4d0a-ac95-377fd3469611'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.216022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] The token cache is being invalidate because project 9280950d88fe497ca6505f2be1ffc693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:38.216706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.217969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.220526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 873/1781] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:37 2022] DELETE /identity/v3/projects/9280950d88fe497ca6505f2be1ffc693 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:38.226335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:38.249812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:38.273890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:38.353427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e654a-f5a5-4902-9e25-c106a6bf203a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:38.396954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239729eb-abed-4d0a-ac95-377fd3469611 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:38.411799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:38.413423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:38.414235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:38.415836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] PATH_INFO: `/v3/users/db9e573a023e4db3a20fcfc40c1f49b5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:38.418600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9e573a023e4db3a20fcfc40c1f49b5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:38.435369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:38.456246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:38.485832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:38.486565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:38.486861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:38.487143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] PATH_INFO: `/v3/users/f701b349ab024bb6a6be815f5e4fff92` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:38.488972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f701b349ab024bb6a6be815f5e4fff92)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:38.491634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:38.557940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9e573a023e4db3a20fcfc40c1f49b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.559104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9e573a023e4db3a20fcfc40c1f49b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.584933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9e573a023e4db3a20fcfc40c1f49b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.598666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f701b349ab024bb6a6be815f5e4fff92'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.610852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9e573a023e4db3a20fcfc40c1f49b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.630212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9e573a023e4db3a20fcfc40c1f49b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.631067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f701b349ab024bb6a6be815f5e4fff92'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.643736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 874/1782] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:38 2022] DELETE /identity/v3/users/db9e573a023e4db3a20fcfc40c1f49b5 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:38.650579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f701b349ab024bb6a6be815f5e4fff92'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.651085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f701b349ab024bb6a6be815f5e4fff92'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.651917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f701b349ab024bb6a6be815f5e4fff92'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:38.703362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 909/1783] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:38 2022] DELETE /identity/v3/users/f701b349ab024bb6a6be815f5e4fff92 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:39.692129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:39.697615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:39.912207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785352-0744-472d-9b63-5fb5d7f8c5ea admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:39.922841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:39.924888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.051481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.152970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.156093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.157395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.158621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] PATH_INFO: `/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.160141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687fbc24-dca7-439b-9e33-1ff4a5d0d7c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.163133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3c02a6a82c4ab2acab41ff46067f2a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.167656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.168792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.169633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.169797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.170135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] PATH_INFO: `/v3/projects/71d365e1d0534ef9add95c9515d6cbdc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.171622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d365e1d0534ef9add95c9515d6cbdc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.175069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.263230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3c02a6a82c4ab2acab41ff46067f2a', 'request_id': 'req-609adb8e-e691-4cad-9f43-e58f37513bfb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.272542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3c02a6a82c4ab2acab41ff46067f2a', 'request_id': 'req-609adb8e-e691-4cad-9f43-e58f37513bfb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.276158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d365e1d0534ef9add95c9515d6cbdc', 'request_id': 'req-372db185-dfaf-4f44-aa83-2df612e9f9fc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.285530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3c02a6a82c4ab2acab41ff46067f2a', 'request_id': 'req-609adb8e-e691-4cad-9f43-e58f37513bfb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.292725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d365e1d0534ef9add95c9515d6cbdc', 'request_id': 'req-372db185-dfaf-4f44-aa83-2df612e9f9fc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.303470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] The token cache is being invalidate because project bb3c02a6a82c4ab2acab41ff46067f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:40.303983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.304489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-609adb8e-e691-4cad-9f43-e58f37513bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.306281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 875/1784] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:39 2022] DELETE /identity/v3/projects/bb3c02a6a82c4ab2acab41ff46067f2a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:40.307528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d365e1d0534ef9add95c9515d6cbdc', 'request_id': 'req-372db185-dfaf-4f44-aa83-2df612e9f9fc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.311661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fd8c-bad3-4527-9682-99470f75350d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.311949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fd8c-bad3-4527-9682-99470f75350d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.312246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71fd8c-bad3-4527-9682-99470f75350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.333043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] The token cache is being invalidate because project 71d365e1d0534ef9add95c9515d6cbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:40.333671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.334822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-372db185-dfaf-4f44-aa83-2df612e9f9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:40.336127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5f71fd8c-bad3-4527-9682-99470f75350d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.338621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 910/1785] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:39 2022] DELETE /identity/v3/projects/71d365e1d0534ef9add95c9515d6cbdc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:40.341546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f71fd8c-bad3-4527-9682-99470f75350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.345921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe28a6-66f0-4490-8804-7c575b6a6ee1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.346473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe28a6-66f0-4490-8804-7c575b6a6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.346930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe28a6-66f0-4490-8804-7c575b6a6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.359003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.385528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6fbe28a6-66f0-4490-8804-7c575b6a6ee1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.387671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6fbe28a6-66f0-4490-8804-7c575b6a6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.447871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 876/1786] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:40.457241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.457836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.458136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.490194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.491922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.511786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 877/1787] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:40.512025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 911/1788] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:40.514478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.520052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.520470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.520907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.534417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1ff6c-6c34-48bc-9a53-c936d06a5dd3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.542822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.544570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.544570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.545011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.545166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.546370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.546546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:40.546969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.551016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.559017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 912/1789] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:40.563947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.575723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 878/1790] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:40.580139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.582744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e38ad-afd2-47eb-806b-02670f2bd2c2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.590218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.591765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.592281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.593042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.595582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:40.596191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.599956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.600922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f389f1d-adf2-4c83-b387-ace98e5540f0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.613381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.615921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.616525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.617203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.620068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.625754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a31e1d-99bb-49f0-9a1a-14d9d7e00cf4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.627709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 913/1791] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:40.628891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.648132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dfb91-eb67-4b39-8aaf-4b1f2bf4ac54 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.662051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.665391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.665913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.667662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.668676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.673462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb79f6-6c3a-4208-b44e-9989616c65a6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.698538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 879/1792] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/projects => generated 364 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:40.700317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809744-281c-400d-85de-2eb25957493e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.700646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809744-281c-400d-85de-2eb25957493e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.701165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32809744-281c-400d-85de-2eb25957493e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.704049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 880/1793] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:41:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:41:40.705103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32809744-281c-400d-85de-2eb25957493e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.720110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 914/1794] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/projects => generated 378 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:40.724900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.725202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.725616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.744734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:40.747848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:40.749644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:40.806604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32809744-281c-400d-85de-2eb25957493e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.886115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 915/1795] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:40.887695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.892308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.893459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.894005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.894683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.895589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.897989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.911974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782efa4-ade6-427f-8a8b-b66da0215612 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.919939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.925083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.925746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.925952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.927596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.930650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 881/1796] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/users => generated 283 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:40.932142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.937110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.949969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d986ab-f81c-4688-bbea-c9cf30f9b525 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:40.956217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:40.957026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:40.957326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:40.957665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:40.958418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:40.960412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:40.975745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 882/1797] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:40.978745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 916/1798] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:40 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:40.983681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:40.984042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.004256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e8511-91df-46f6-92ce-f76b9f80020a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.010546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.011239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.011531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.011814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.014020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.017173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.027362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792368d9-b326-4fc5-892d-e6cd8afc2d91 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.037203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.037695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 917/1799] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:41.038876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.040296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.041062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.041773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.043899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.047539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.065038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7bb1d6-04c4-4ce5-be86-20976d5f990c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.073265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.073961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.074252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.074535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.075662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.077719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.094521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 918/1800] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:41 2022] GET /identity/v3/roles => generated 1427 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:41.101679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.104957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 883/1801] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:40 2022] GET /identity/v3/roles => generated 1427 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:41.106691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.111930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54f450-75d2-4968-af49-c74c5aee092d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.119958 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.124331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.124837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.125298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] PATH_INFO: `/v3/projects/625a8519530049839c6ea2c290ee9fb3/users/c4d8e9273f7647c79cc7bd5f9aa54c4c/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.138400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed91ad-066c-437c-b3ad-1983407039a3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.142936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:41.148627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] RBAC: Authorizing `identity:create_grant(project_id=625a8519530049839c6ea2c290ee9fb3, user_id=c4d8e9273f7647c79cc7bd5f9aa54c4c, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.153854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486a26d-599c-41a5-89a5-5c43e61904be admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.163213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.169286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.169806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.170333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] PATH_INFO: `/v3/projects/9dbb264d89d44796b45ae01d009b55f5/users/9fbef845b48f452bbb2ab129d33cce6c/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.176822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 919/1802] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:41 2022] PUT /identity/v3/projects/625a8519530049839c6ea2c290ee9fb3/users/c4d8e9273f7647c79cc7bd5f9aa54c4c/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:41.198040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.198388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.198672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.231928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbb264d89d44796b45ae01d009b55f5, user_id=9fbef845b48f452bbb2ab129d33cce6c, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.238695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ff91b-2a2a-4b0c-a0ce-c6972cd6a9be admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.255655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] MFA Rules not processed for user `c4d8e9273f7647c79cc7bd5f9aa54c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:41.257282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:41.273148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 884/1803] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:41 2022] PUT /identity/v3/projects/9dbb264d89d44796b45ae01d009b55f5/users/9fbef845b48f452bbb2ab129d33cce6c/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:41.286255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.286529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.286885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.332146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] MFA Rules not processed for user `9fbef845b48f452bbb2ab129d33cce6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:41.333569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:41.456530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:41.474305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 885/1804] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:41.481960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.483473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:41.488306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 920/1805] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:41.495333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.658077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8375b4-4e83-4eaf-a402-1df5cbe58bb8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.670280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.671020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.671308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.671598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.684323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1c84a-a406-41c2-9c64-43ed57bfc120 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.696962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.698600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.699525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.700752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.702366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.702662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.703497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.708554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.729194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 886/1806] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:41.731930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.737697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:41.786300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 921/1807] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:41 2022] POST /identity/v3/projects => generated 366 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:41.793558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:41.933093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703c0a2-f5d8-469e-bfb4-a71e8af4990b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:41.950798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:41.954594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:41.955176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:41.955751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:41.957251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:41.966499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:41.993222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:42.007485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a73af-31a2-411e-a985-ee71a3f4f5b9 service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:42.053469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 922/1808] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:41 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:42.057106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:42.076789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384c222-b585-4ce4-b8eb-549ecdf02970 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:42.087547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:42.089056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.089760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.090262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.091678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:42.096297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:42.125427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:42.126468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.127870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.128959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.130177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 923/1809] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:42 2022] GET /identity/v3/roles => generated 1427 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:42.136657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:42.145963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:42.148072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:42.167095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250d088-5aa7-4936-bcaa-5a2e67a52076 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:42.172001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 887/1810] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:42.177675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:42.178644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.179014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.179446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] PATH_INFO: `/v3/projects/292201911ac9475bbaf9c257f89dc414/users/621e1705cd6f4cbb9b8fd1e7699ec36e/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.220179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292201911ac9475bbaf9c257f89dc414, user_id=621e1705cd6f4cbb9b8fd1e7699ec36e, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:42.225123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:42.260798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 924/1811] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:42 2022] PUT /identity/v3/projects/292201911ac9475bbaf9c257f89dc414/users/621e1705cd6f4cbb9b8fd1e7699ec36e/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:42.267655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:42.292845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9bc43f-40b1-4bcf-9915-08aff44d37b1 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:42.390805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:42.529617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:42.535640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.536160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.536826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.538444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:42.545444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e108a51-01e2-4feb-9e7c-a8362d22721f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:42.591839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:42.603127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 888/1812] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:42 2022] GET /identity/v3/roles => generated 1427 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:42.625096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8446cfa-c8be-458b-803a-aa4ffdd14db3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:42.636140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:42.638247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.639052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.639529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] PATH_INFO: `/v3/projects/292201911ac9475bbaf9c257f89dc414/users/621e1705cd6f4cbb9b8fd1e7699ec36e/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.644658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292201911ac9475bbaf9c257f89dc414, user_id=621e1705cd6f4cbb9b8fd1e7699ec36e, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:42.650890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:42.676482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 925/1813] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:42 2022] PUT /identity/v3/projects/292201911ac9475bbaf9c257f89dc414/users/621e1705cd6f4cbb9b8fd1e7699ec36e/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:42.697407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:42.697991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:42.698458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:42.756828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] MFA Rules not processed for user `621e1705cd6f4cbb9b8fd1e7699ec36e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:42.759045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:42.934299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 889/1814] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:42.952529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:42.957227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:43.083251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb272f2-39d9-470e-b8d4-0e35ee99acc9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:43.089607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:43.090674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:43.091186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:43.091689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:43.112017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:43.114238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:43.130262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 926/1815] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:43.230398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:43.248255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8f37b-dd0d-468c-a59e-7987e7138ff7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:43.254511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:43.256317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:43.256570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:43.256987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:43.353238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:43.355861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb82d19-a6aa-4f1d-8298-177280240920 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:43.373516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 890/1816] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:48.496631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.607822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d37ae-464f-4a05-baf6-43349f7837f3 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:48.615393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:48.617007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.617495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.618172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] PATH_INFO: `/v3/users/c4d8e9273f7647c79cc7bd5f9aa54c4c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.620486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d8e9273f7647c79cc7bd5f9aa54c4c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:48.624136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:48.700836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d8e9273f7647c79cc7bd5f9aa54c4c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:48.703576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:48.722954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d8e9273f7647c79cc7bd5f9aa54c4c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:48.733557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d8e9273f7647c79cc7bd5f9aa54c4c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:48.736246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d8e9273f7647c79cc7bd5f9aa54c4c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:48.737472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d8e9273f7647c79cc7bd5f9aa54c4c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:48.763382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 927/1817] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:48 2022] DELETE /identity/v3/users/c4d8e9273f7647c79cc7bd5f9aa54c4c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:48.769856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:48.770784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:48.770784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:48.792492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:48.793756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:48.852604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:48.890873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 891/1818] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:48.903362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:48.905967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:48.995768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35fbaf-5d8e-478b-94e4-e77a9eccd3aa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.000307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.001024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.001317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.001602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.012798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.017662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.036809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 928/1819] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:49.487721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:49.489617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:49.510305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83d1f5-bb92-43a2-a4a9-2966ca0f9108 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.518693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.520449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.521100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.521598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] PATH_INFO: `/v3/projects/625a8519530049839c6ea2c290ee9fb3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.524660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625a8519530049839c6ea2c290ee9fb3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.528506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.594286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625a8519530049839c6ea2c290ee9fb3', 'request_id': 'req-e0917c6a-2d13-40f4-9db8-2610b1317963'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.600578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625a8519530049839c6ea2c290ee9fb3', 'request_id': 'req-e0917c6a-2d13-40f4-9db8-2610b1317963'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.610255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625a8519530049839c6ea2c290ee9fb3', 'request_id': 'req-e0917c6a-2d13-40f4-9db8-2610b1317963'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.624347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] The token cache is being invalidate because project 625a8519530049839c6ea2c290ee9fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:49.624659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.625336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.626957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 892/1820] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:49 2022] DELETE /identity/v3/projects/625a8519530049839c6ea2c290ee9fb3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:49.631875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:49.650217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889aa9da-c813-44d0-beab-36088843cd2d service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:49.735315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:49.736134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:49.736449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:49.736738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] PATH_INFO: `/v3/users/621e1705cd6f4cbb9b8fd1e7699ec36e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:49.738039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=621e1705cd6f4cbb9b8fd1e7699ec36e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:49.740005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:49.800677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621e1705cd6f4cbb9b8fd1e7699ec36e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.817109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621e1705cd6f4cbb9b8fd1e7699ec36e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.826576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621e1705cd6f4cbb9b8fd1e7699ec36e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.827336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621e1705cd6f4cbb9b8fd1e7699ec36e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.828146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ef46050-9b7d-4538-b924-b2ea99dd0e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621e1705cd6f4cbb9b8fd1e7699ec36e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:49.829936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:49.847808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 929/1821] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:49 2022] DELETE /identity/v3/users/621e1705cd6f4cbb9b8fd1e7699ec36e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:50.484918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:50.486947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:50.530811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0917c6a-2d13-40f4-9db8-2610b1317963 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:50.626243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:50.627351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:50.627500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:50.627750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] PATH_INFO: `/v3/projects/292201911ac9475bbaf9c257f89dc414` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:50.629147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=292201911ac9475bbaf9c257f89dc414)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:50.631143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:50.700327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292201911ac9475bbaf9c257f89dc414', 'request_id': 'req-b9517178-8c61-4579-a1a0-81eafdefff4e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:50.707583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292201911ac9475bbaf9c257f89dc414', 'request_id': 'req-b9517178-8c61-4579-a1a0-81eafdefff4e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:50.718824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292201911ac9475bbaf9c257f89dc414', 'request_id': 'req-b9517178-8c61-4579-a1a0-81eafdefff4e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:50.730427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:50.735871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] The token cache is being invalidate because project 292201911ac9475bbaf9c257f89dc414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:50.737274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:50.738631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b9517178-8c61-4579-a1a0-81eafdefff4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:50.740948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 893/1822] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:50 2022] DELETE /identity/v3/projects/292201911ac9475bbaf9c257f89dc414 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:50.746716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:50.747661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:50.747911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:50.771555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:50.773128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:50.854177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 930/1823] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:50.862300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:50.862664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:50.862994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:50.886353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:50.887595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:50.896711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 894/1824] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:50.902996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:50.920951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a37d7-57cb-4161-9d51-7c422756eff4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:50.929267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:50.930409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:50.930917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:50.931410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:50.932795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:50.933347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:50.936404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:50.959691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 931/1825] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:41:50.964860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:50.975217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cdc3c-d850-465f-b4f8-58d3d52d359c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:50.980110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:50.980959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:50.981242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:50.981519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:50.982248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:50.984319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.032435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 895/1826] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:50 2022] POST /identity/v3/projects => generated 370 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:51.037292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.049963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e414d-aa71-47bf-abe9-1050b8e90130 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.125749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.126513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.127050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.127224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.128113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.130294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.154847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 932/1827] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:51.159315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.170736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9cb49-0d53-48be-9173-2327e4fb6651 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.176680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.177437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.177764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.178120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.178917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.180736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.194574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 896/1828] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:51.199693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.212731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c47524-8f81-4cb5-b8ae-01b205ed88c3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.218116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.218917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.219318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.219660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.220724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.222647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e49fae-f393-4451-b942-d70d0e66d7c3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.234949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 933/1829] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:51.240224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.251774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e8623c-9c96-469f-98ce-b5c068c611a7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.257210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.258195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.259145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.259469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] PATH_INFO: `/v3/projects/47c08f28c26c4020af2997c76ce52447/users/32bf5a65dc6d45519a97fa52afd37fe7/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.277660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c08f28c26c4020af2997c76ce52447, user_id=32bf5a65dc6d45519a97fa52afd37fe7, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.280445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.296143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 897/1830] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:51 2022] PUT /identity/v3/projects/47c08f28c26c4020af2997c76ce52447/users/32bf5a65dc6d45519a97fa52afd37fe7/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:51.308685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.309173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.309625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.349502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] MFA Rules not processed for user `32bf5a65dc6d45519a97fa52afd37fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:51.351315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:51.438611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:51.483290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 934/1831] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:41:51.490764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.596143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82ff38-6579-4ea6-b6c5-60a814d39fd7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.602120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.603044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.603433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.603807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.604751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.607095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.643551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 898/1832] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/projects => generated 370 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:51.648070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.661448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0b779-fc47-4542-9516-67ea810f4e5c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.759897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.760939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.761081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.761496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.762525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.765035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.797688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 935/1833] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:51 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:51.802384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.817960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe854e6-ff06-450b-8bf3-764745baf977 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.826281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.827245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.827590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.827958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.828852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.831353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.852273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 899/1834] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:51.857110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.868599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf658d-bbe5-4670-8aeb-9312c5dd7e75 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:51.874634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:51.875785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:51.876163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:51.876611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] PATH_INFO: `/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a/users/0cf14d68f99547109fdcb9f8471bf187/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:51.901751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1b4325002c4f8e8c7a5d7a9f00cb6a, user_id=0cf14d68f99547109fdcb9f8471bf187, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:51.906221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:51.932454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 936/1835] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:51 2022] PUT /identity/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a/users/0cf14d68f99547109fdcb9f8471bf187/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:41:51.942348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:51.968711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715f061-4e26-4892-88d1-e0061dc0c1ab admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:52.082776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:52.084037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:52.084594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:52.085112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:52.086998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:52.090919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44cd2-a135-42ae-ad9a-35823b44861e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:52.114186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 900/1836] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:51 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:52.120154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:52.132984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ad8e1-15f0-40ef-8bd7-5c749296418b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:52.140088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:52.141744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:52.142204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:52.142672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] PATH_INFO: `/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a/users/0cf14d68f99547109fdcb9f8471bf187/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:52.146903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1b4325002c4f8e8c7a5d7a9f00cb6a, user_id=0cf14d68f99547109fdcb9f8471bf187, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:52.151691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:52.166540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 937/1837] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:52 2022] PUT /identity/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a/users/0cf14d68f99547109fdcb9f8471bf187/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:52.184125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916802-5533-4524-9c8e-3d300380e84c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:52.184639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916802-5533-4524-9c8e-3d300380e84c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:52.185068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19916802-5533-4524-9c8e-3d300380e84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:52.207420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:52.234761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-19916802-5533-4524-9c8e-3d300380e84c None None] MFA Rules not processed for user `0cf14d68f99547109fdcb9f8471bf187`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:52.237138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-19916802-5533-4524-9c8e-3d300380e84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:52.370396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 901/1838] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:52.389179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:52.391601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:52.478521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f79a16-ca97-4ca5-bf94-71e38af1836b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:52.483966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:52.485077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:52.485438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:52.485777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:52.506976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:52.510742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e1349-cd4f-4246-89e2-97add961f4e1 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:52.535121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 938/1839] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:41:55.480676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916802-5533-4524-9c8e-3d300380e84c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:55.642567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19916802-5533-4524-9c8e-3d300380e84c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:55.663783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:55.664681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.664980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.665265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] PATH_INFO: `/v3/users/32bf5a65dc6d45519a97fa52afd37fe7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:55.673875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bf5a65dc6d45519a97fa52afd37fe7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:55.678121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:55.816767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bf5a65dc6d45519a97fa52afd37fe7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:55.824023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bf5a65dc6d45519a97fa52afd37fe7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:55.850665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bf5a65dc6d45519a97fa52afd37fe7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:55.884832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bf5a65dc6d45519a97fa52afd37fe7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:55.911445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bf5a65dc6d45519a97fa52afd37fe7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:55.932863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 902/1840] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:55 2022] DELETE /identity/v3/users/32bf5a65dc6d45519a97fa52afd37fe7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:55.940358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c276e-f472-4518-9093-003830960a73 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:55.940927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c276e-f472-4518-9093-003830960a73 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:55.941621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c276e-f472-4518-9093-003830960a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.031777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b85c276e-f472-4518-9093-003830960a73 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:56.031777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b85c276e-f472-4518-9093-003830960a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:56.135895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.222700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 939/1841] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:56.237415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.241025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:56.276237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:56.392359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5ad00-ab50-4a44-8e07-3a6f4fb25fa9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:56.400273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:56.401466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:56.401952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:56.402451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:56.428508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:56.431509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:56.462264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 903/1842] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:41:56.942266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c276e-f472-4518-9093-003830960a73 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:56.945105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b85c276e-f472-4518-9093-003830960a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:56.985533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c276e-f472-4518-9093-003830960a73 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.002901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.004545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.005048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.005565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] PATH_INFO: `/v3/projects/47c08f28c26c4020af2997c76ce52447` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.008073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c08f28c26c4020af2997c76ce52447)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.011771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.108942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c08f28c26c4020af2997c76ce52447', 'request_id': 'req-3dad97e1-6c3b-4320-adf4-52a058433711'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.121203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c08f28c26c4020af2997c76ce52447', 'request_id': 'req-3dad97e1-6c3b-4320-adf4-52a058433711'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.131661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c08f28c26c4020af2997c76ce52447', 'request_id': 'req-3dad97e1-6c3b-4320-adf4-52a058433711'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.148303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] The token cache is being invalidate because project 47c08f28c26c4020af2997c76ce52447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:57.148642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.149458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.151073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 940/1843] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:56 2022] DELETE /identity/v3/projects/47c08f28c26c4020af2997c76ce52447 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:57.155587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.167200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be1a0-b220-4358-9d86-fe5b24c8dd78 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:57.251479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:57.253071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:57.253451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:57.253838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] PATH_INFO: `/v3/users/0cf14d68f99547109fdcb9f8471bf187` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:57.255627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf14d68f99547109fdcb9f8471bf187)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:57.257763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:57.330265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf14d68f99547109fdcb9f8471bf187'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.331527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf14d68f99547109fdcb9f8471bf187'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.350271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf14d68f99547109fdcb9f8471bf187'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.362957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf14d68f99547109fdcb9f8471bf187'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.384439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-73c33d19-bddb-41f2-8eb9-6408cbc8859d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf14d68f99547109fdcb9f8471bf187'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:57.394178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 904/1844] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:41:57 2022] DELETE /identity/v3/users/0cf14d68f99547109fdcb9f8471bf187 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:57.985341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:57.987571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:58.031703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad97e1-6c3b-4320-adf4-52a058433711 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:58.238081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.243641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.244211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.244676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] PATH_INFO: `/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.246301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1b4325002c4f8e8c7a5d7a9f00cb6a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.249821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.336160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1b4325002c4f8e8c7a5d7a9f00cb6a', 'request_id': 'req-cf78b763-3445-4752-a584-4990aef8b895'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:58.349444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1b4325002c4f8e8c7a5d7a9f00cb6a', 'request_id': 'req-cf78b763-3445-4752-a584-4990aef8b895'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:58.363943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1b4325002c4f8e8c7a5d7a9f00cb6a', 'request_id': 'req-cf78b763-3445-4752-a584-4990aef8b895'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:58.375763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:58.390141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] The token cache is being invalidate because project 3b1b4325002c4f8e8c7a5d7a9f00cb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:41:58.391592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:58.393576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cf78b763-3445-4752-a584-4990aef8b895 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:41:58.402479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 941/1845] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:41:57 2022] DELETE /identity/v3/projects/3b1b4325002c4f8e8c7a5d7a9f00cb6a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:58.405226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.405780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.406165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.445575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:58.448103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:58.515816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:58.586878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.586878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.586878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.589425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 905/1846] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:58.650037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:58.654654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:58.705084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 942/1847] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:58.708793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:58.723631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ae3a-06f4-49eb-bf0e-3fa11e373c7a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:58.731061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.732108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.732544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.733154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.734108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:41:58.734610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.738647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.757776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 906/1848] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:41:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:41:58.762620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:58.777993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d59f7d-cc85-482d-a994-c370ab498eb0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:58.790378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:58.791275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:58.791566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:58.792043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:58.792800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:58.795105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:58.867370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:58.869236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 943/1849] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:58 2022] POST /identity/v3/projects => generated 388 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:58.904027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d97400-0653-4fa2-a2e7-9662d4e4f6e5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.104355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.106807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.107381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.107878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.109288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.123620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.182350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 907/1850] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:58 2022] POST /identity/v3/users => generated 295 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:41:59.186450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.199960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee2293-eb92-4955-993c-3a1d7cfb782c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.205311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.206433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.206714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.207219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.217859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.220778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.237848 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 944/1851] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:59 2022] GET /identity/v3/roles => generated 1427 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:59.241597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.273576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93616faa-563d-44c9-8ce9-6a9d3cbcda18 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.284839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.286018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.286525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.287000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.288388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.291794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a815f-3a94-4c06-81da-64712e291430 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.316743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 908/1852] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:59 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:41:59.318889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.339937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfee4b4-3b56-40cb-9196-c482876514f9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.349017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.350782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.352005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.352005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] PATH_INFO: `/v3/projects/9bb5c7a93c6d4d76a27cbb10c2b5b79c/users/8e0910bbd0e843c284a247e6ccefc929/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.391506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb5c7a93c6d4d76a27cbb10c2b5b79c, user_id=8e0910bbd0e843c284a247e6ccefc929, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.397854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.426382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 945/1853] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:41:59 2022] PUT /identity/v3/projects/9bb5c7a93c6d4d76a27cbb10c2b5b79c/users/8e0910bbd0e843c284a247e6ccefc929/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:41:59.446444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.447018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.447525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.513266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] MFA Rules not processed for user `8e0910bbd0e843c284a247e6ccefc929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:41:59.514589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:41:59.602249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 909/1854] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:41:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:41:59.607486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.685415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a71256-cf5f-47a6-b778-7228c7a3607d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.690447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.691732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.692186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.692784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.693666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.696658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.734759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 946/1855] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:41:59 2022] POST /identity/v3/projects => generated 386 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:59.736446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.756752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ea159-2338-4c24-9c48-ec784e4f0fbb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.794339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:41:59.868909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.869711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.870224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.870701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.872117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.875948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.911860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 910/1856] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:41:59 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:41:59.913304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:41:59.934415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1470c14-c431-464a-b4e6-3d4ce1be96ed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:41:59.957294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:41:59.958310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:41:59.958793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:41:59.959271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:41:59.960301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:41:59.963836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:41:59.984912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 947/1857] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:59 2022] GET /identity/v3/roles => generated 1427 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:41:59.990006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.015772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f314c1-8d06-480d-843b-763bce399dd3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.023983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.025737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.025737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.026235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.027628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.030881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df774863-a827-462c-9204-6a4c60619f91 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.060940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 911/1858] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:41:59 2022] GET /identity/v3/roles => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:00.065018 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.100015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11df8d-5979-43ba-a0ce-a234667f2e65 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.107771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.109155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.110079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.110526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] PATH_INFO: `/v3/projects/9712ce03e8524d739da56c30cc805c91/users/70a6d22ea17e49ce96422db91da55fbb/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.131663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9712ce03e8524d739da56c30cc805c91, user_id=70a6d22ea17e49ce96422db91da55fbb, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.136716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.157580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 948/1859] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:00 2022] PUT /identity/v3/projects/9712ce03e8524d739da56c30cc805c91/users/70a6d22ea17e49ce96422db91da55fbb/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:00.178690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.179260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.179671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.220415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] MFA Rules not processed for user `70a6d22ea17e49ce96422db91da55fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:00.221769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:00.318544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 912/1860] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:00.325049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.390969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:00.425524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2642a65-50bf-4688-b4cd-39caf3218845 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.431259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.431954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.432242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.432577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.433318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.435469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.496879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 949/1861] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/projects => generated 388 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:00.499193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.512484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a529d6f-9c96-4e91-886c-b2d1cf9ebbe4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.628745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.630202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.630766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.631329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.632861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.638074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.684770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 913/1862] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:00 2022] POST /identity/v3/users => generated 301 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:00.690685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.710683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5272d4-5dad-4bcc-98b9-d2f28b70b77e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.720221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.721459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.721967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.722462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.724152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.727335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.754518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 950/1863] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:00 2022] GET /identity/v3/roles => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:00.759202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.772572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb8793-c701-409c-99a0-0ee95461caef admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.780413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.781449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.783693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.783693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] PATH_INFO: `/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef/users/f3dce16b3e274519b3db453ee61c2747/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.808058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eb7af437db49c3a27ed96ca5a219ef, user_id=f3dce16b3e274519b3db453ee61c2747, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.814040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.848435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 914/1864] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:00 2022] PUT /identity/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef/users/f3dce16b3e274519b3db453ee61c2747/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:00.850843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:00.871178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759dd946-12b8-4804-af55-924a9af8b33c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:00.974015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:00.974717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:00.975012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:00.975299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:00.976051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:00.977982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:00.989964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 951/1865] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:00 2022] GET /identity/v3/roles => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:00.995392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.007579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.017347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de510094-17e5-485a-b437-f5a1af8c880d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.023891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.025507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.025944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.026371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] PATH_INFO: `/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef/users/f3dce16b3e274519b3db453ee61c2747/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.030019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eb7af437db49c3a27ed96ca5a219ef, user_id=f3dce16b3e274519b3db453ee61c2747, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.036492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fee672-ef5b-45ee-876d-aee3fe6530ea admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.057237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 915/1866] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:00 2022] PUT /identity/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef/users/f3dce16b3e274519b3db453ee61c2747/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:01.066408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.069660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.075498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.075958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.076546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.092891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da083-266a-449c-ae29-e8b8a8dede16 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.125862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] MFA Rules not processed for user `f3dce16b3e274519b3db453ee61c2747`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:01.127888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.232757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.234361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.235010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.235431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] PATH_INFO: `/v3/users/80a9f2886865441693ee95403bbde99e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.238098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a9f2886865441693ee95403bbde99e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.241953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.293019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 916/1867] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:01.302918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.306296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.355857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a9f2886865441693ee95403bbde99e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:01.366180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.387831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a9f2886865441693ee95403bbde99e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:01.404071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a9f2886865441693ee95403bbde99e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:01.406362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a9f2886865441693ee95403bbde99e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:01.409171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ff08818d-44a2-4f87-b934-919b76f15ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a9f2886865441693ee95403bbde99e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:01.423673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dec07-5fb8-4c3f-bcbe-ee7300666b2b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.428005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.428933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.429228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.429512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.431661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.449879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.451547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.455810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 952/1868] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:01 2022] DELETE /identity/v3/users/80a9f2886865441693ee95403bbde99e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:01.458890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.459440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.459993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.478453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 917/1869] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:01.493811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:01.496873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.666936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 953/1870] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:01.683835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:01.686192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:01.795338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2945e-4aac-4102-8907-422f171bc757 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:01.862621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:01.922791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:01.924583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:01.925528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:01.926145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:01.947307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:01.950371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:01.970885 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 918/1871] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:02.435487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.438115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.544299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b16f9-6e54-4847-94be-15c20b1f7492 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.550121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.551207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.551992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.551992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.555479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.627221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.628864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:02.651981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a0735-fec4-455b-9549-c1e69565107d service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.675412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:02.690217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:02.691305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:02.691305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] PATH_INFO: `/v3/projects/1f5d6439c00b4d2eb7793ac383b5146e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:02.703904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5d6439c00b4d2eb7793ac383b5146e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.707175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.714664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:02.716620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:02.738180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 954/1872] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:02.819333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5d6439c00b4d2eb7793ac383b5146e', 'request_id': 'req-4b45ea52-2857-4d60-8151-76cd75be1a21'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:02.833142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5d6439c00b4d2eb7793ac383b5146e', 'request_id': 'req-4b45ea52-2857-4d60-8151-76cd75be1a21'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:02.847091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5d6439c00b4d2eb7793ac383b5146e', 'request_id': 'req-4b45ea52-2857-4d60-8151-76cd75be1a21'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:02.899242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] The token cache is being invalidate because project 1f5d6439c00b4d2eb7793ac383b5146e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:02.899788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:02.900974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:02.907349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 919/1873] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:02 2022] DELETE /identity/v3/projects/1f5d6439c00b4d2eb7793ac383b5146e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:02.915171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:02.949650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a147e-1f0f-41d8-863f-fda9daec0fa3 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:02.980731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.062509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.065222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.065773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.066510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] PATH_INFO: `/v3/users/f81353a34b6b438a87cb1052e9d06ff4` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.071201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81353a34b6b438a87cb1052e9d06ff4)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.074980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.175637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81353a34b6b438a87cb1052e9d06ff4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.198761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81353a34b6b438a87cb1052e9d06ff4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.217203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81353a34b6b438a87cb1052e9d06ff4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.218303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81353a34b6b438a87cb1052e9d06ff4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.219173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9ab3b2be-663c-4667-9798-080ba7405550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81353a34b6b438a87cb1052e9d06ff4'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.242206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 955/1874] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:02 2022] DELETE /identity/v3/users/f81353a34b6b438a87cb1052e9d06ff4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:03.679532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:03.681162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:03.698573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea52-2857-4d60-8151-76cd75be1a21 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:03.770127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:03.771019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.771308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.771587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] PATH_INFO: `/v3/projects/011000aa6bba4df59d3b11caef1b6e10` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.773027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011000aa6bba4df59d3b11caef1b6e10)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:03.775081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:03.833338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011000aa6bba4df59d3b11caef1b6e10', 'request_id': 'req-04b602e5-60b1-4eea-a0ba-539dea07f565'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.839850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011000aa6bba4df59d3b11caef1b6e10', 'request_id': 'req-04b602e5-60b1-4eea-a0ba-539dea07f565'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.842675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:03.850461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011000aa6bba4df59d3b11caef1b6e10', 'request_id': 'req-04b602e5-60b1-4eea-a0ba-539dea07f565'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.867494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] The token cache is being invalidate because project 011000aa6bba4df59d3b11caef1b6e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:03.868624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.869543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-04b602e5-60b1-4eea-a0ba-539dea07f565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:03.871280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 920/1875] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:03 2022] DELETE /identity/v3/projects/011000aa6bba4df59d3b11caef1b6e10 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:03.876472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:03.876994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:03.877251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:03.901552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:03.904182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:03.991711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 956/1876] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:04.005241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.005858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.006470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.039232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:04.042075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:04.056660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 921/1877] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:04.063431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.083427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7f3c6-c8c4-4f9b-8c09-114f3ab14a40 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.092157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.093359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.093856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.094627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.096054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:04.096693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.100316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.127705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 957/1878] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:04.133931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.160996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298f61e-dc9a-4bc2-b0ee-ec97e5c536fc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.173608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.176083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.176897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.177401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.178700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.182596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.241656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 922/1879] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/projects => generated 388 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:04.245928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.259625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd010c-a1d5-4469-b975-0af48a70db41 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.300895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:04.365384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.366488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.366967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.367469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.368910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.372889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.415044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 958/1880] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:04.418141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.436771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462f48e-2bc3-42b0-881c-bfedc3df9d78 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.442553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.443291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.443614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.443934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.444987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.448001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.463031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 923/1881] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:04 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:04.467753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.478834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2dbee2-232c-4755-ac6b-4ad31b8691a3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.484036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.484913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.485242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.485561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.486427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.488270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e642d-afbb-4d23-b028-331f1775aa02 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.500746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 959/1882] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:04 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:04.505607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.516830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb952a-d541-40ca-9ae1-0915b676ba2a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.522674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.523595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.523880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.524756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] PATH_INFO: `/v3/projects/6f7ad81828e3402e99353fbf69064f54/users/e4f765e577cb4a82a613a997420ef1b3/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.543006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7ad81828e3402e99353fbf69064f54, user_id=e4f765e577cb4a82a613a997420ef1b3, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.545917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.565364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 924/1883] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:04 2022] PUT /identity/v3/projects/6f7ad81828e3402e99353fbf69064f54/users/e4f765e577cb4a82a613a997420ef1b3/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:04.588507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.589717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.589717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.632015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] MFA Rules not processed for user `e4f765e577cb4a82a613a997420ef1b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:04.634236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:04.743640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 960/1884] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:04.749498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.842050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a72825-74a6-4ed9-8411-e15f1ce44b97 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.847523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.848215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.848542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.848827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.849528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.851527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:04.882487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 925/1885] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/projects => generated 388 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:04.889938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:04.901575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbb3ba-bbcf-4a1f-b431-1dc368ef2c7e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:04.979337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:04.980192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:04.980728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:04.981243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:04.982453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:04.986244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.024583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 961/1886] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:04 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:05.029132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.040756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff253a-55ae-424f-9a88-d77b7abefc24 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.046364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.047120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.047403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.047680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.048470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.050191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.064153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 926/1887] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:05.069423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.081340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f677557-d4a6-4bdd-b271-230e01d0499a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.086239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.087164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.087450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.087756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] PATH_INFO: `/v3/projects/fbf247b8cada4d79aab62d599dab8378/users/dba48762f4304bc390f1ce84fe20ddc0/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.105374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf247b8cada4d79aab62d599dab8378, user_id=dba48762f4304bc390f1ce84fe20ddc0, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.108176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.126121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 962/1888] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:05 2022] PUT /identity/v3/projects/fbf247b8cada4d79aab62d599dab8378/users/dba48762f4304bc390f1ce84fe20ddc0/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:05.130842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.141937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32eb762-3da2-4b40-b2cb-600666654098 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.248640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.249617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.250076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.250478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.251452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.253354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a038665-d1af-422f-a8f0-26f40a2213cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.256938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.278029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 927/1889] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/roles => generated 1427 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:05.280094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.293056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.301009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc993c-da5a-4b18-a21d-f501bb57db94 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.313367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.319565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.319565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.320154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] PATH_INFO: `/v3/projects/fbf247b8cada4d79aab62d599dab8378/users/dba48762f4304bc390f1ce84fe20ddc0/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.322859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf247b8cada4d79aab62d599dab8378, user_id=dba48762f4304bc390f1ce84fe20ddc0, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.326709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.341334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 963/1890] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:05 2022] PUT /identity/v3/projects/fbf247b8cada4d79aab62d599dab8378/users/dba48762f4304bc390f1ce84fe20ddc0/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:05.355495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.355947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.356480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.396227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] MFA Rules not processed for user `dba48762f4304bc390f1ce84fe20ddc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:05.397916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:05.548599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 928/1891] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:05.564718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.567780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:05.669502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72752be-e8b0-4f56-8fb0-da8c8fc91da2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.674921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.675742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.676182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.676571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.688258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.690102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711b073-fdfe-4cac-9c0c-b849465f4275 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.706250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 964/1892] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:05.741739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:05.825628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc7d7f-20d0-42e6-b31e-8d8129a8f6a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:05.834092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:05.835642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.838387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.838387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] PATH_INFO: `/v3/users/e4f765e577cb4a82a613a997420ef1b3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:05.839659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4f765e577cb4a82a613a997420ef1b3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:05.843592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:05.918249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4f765e577cb4a82a613a997420ef1b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:05.919910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4f765e577cb4a82a613a997420ef1b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:05.937235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4f765e577cb4a82a613a997420ef1b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:05.949793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4f765e577cb4a82a613a997420ef1b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:05.965151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4f765e577cb4a82a613a997420ef1b3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:05.970084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:05.983594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 929/1893] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:05 2022] DELETE /identity/v3/users/e4f765e577cb4a82a613a997420ef1b3 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:05.985368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:05.986277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:05.986437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.019255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:06.020879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:06.108213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 965/1894] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:06.119175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.120863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:06.192694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929a426-2dbc-42ba-906c-7d2c6b6ffbdf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.197855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.198670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.198978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.199274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.210833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:06.213054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:06.224455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 930/1895] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:06.790903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.793427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:06.825941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc2f28-0aca-4a9f-ad4e-b18d09e4f8ae None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:06.838329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:06.839237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:06.839638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:06.839933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] PATH_INFO: `/v3/projects/6f7ad81828e3402e99353fbf69064f54` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:06.841480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7ad81828e3402e99353fbf69064f54)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:06.843530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:06.931492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7ad81828e3402e99353fbf69064f54', 'request_id': 'req-11b90113-c1f6-4d8e-85fa-15e5acf86500'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:06.948515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7ad81828e3402e99353fbf69064f54', 'request_id': 'req-11b90113-c1f6-4d8e-85fa-15e5acf86500'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:06.958912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7ad81828e3402e99353fbf69064f54', 'request_id': 'req-11b90113-c1f6-4d8e-85fa-15e5acf86500'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:06.977924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] The token cache is being invalidate because project 6f7ad81828e3402e99353fbf69064f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:06.978296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:06.979183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:06.981355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 966/1896] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:06 2022] DELETE /identity/v3/projects/6f7ad81828e3402e99353fbf69064f54 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:06.986341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:06.998624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a2ab4-ef91-4cf4-9836-bb671e500fe3 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:07.089558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:07.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] PATH_INFO: `/v3/users/dba48762f4304bc390f1ce84fe20ddc0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba48762f4304bc390f1ce84fe20ddc0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:07.094843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:07.183254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba48762f4304bc390f1ce84fe20ddc0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.184139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba48762f4304bc390f1ce84fe20ddc0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.221068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba48762f4304bc390f1ce84fe20ddc0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.235511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba48762f4304bc390f1ce84fe20ddc0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.251268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b803745f-c200-4bed-bd04-3c51b69b6a67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba48762f4304bc390f1ce84fe20ddc0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.265288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 931/1897] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:06 2022] DELETE /identity/v3/users/dba48762f4304bc390f1ce84fe20ddc0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:07.647492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:07.649321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:07.666838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b90113-c1f6-4d8e-85fa-15e5acf86500 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:07.688900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:07.763174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:07.764075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.764362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.764682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] PATH_INFO: `/v3/projects/fbf247b8cada4d79aab62d599dab8378` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.765992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf247b8cada4d79aab62d599dab8378)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:07.767955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:07.834906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf247b8cada4d79aab62d599dab8378', 'request_id': 'req-f42111c4-08e6-495a-89e2-5469d918a63d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.849886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf247b8cada4d79aab62d599dab8378', 'request_id': 'req-f42111c4-08e6-495a-89e2-5469d918a63d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.864993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf247b8cada4d79aab62d599dab8378', 'request_id': 'req-f42111c4-08e6-495a-89e2-5469d918a63d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.882887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] The token cache is being invalidate because project fbf247b8cada4d79aab62d599dab8378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:07.883395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.884523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f42111c4-08e6-495a-89e2-5469d918a63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:07.887619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 967/1898] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:07 2022] DELETE /identity/v3/projects/fbf247b8cada4d79aab62d599dab8378 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:07.894669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:07.895077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:07.895444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:07.921956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:07.924515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:07.961535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.036805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 932/1899] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:08.045144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.045553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.045995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.067782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:08.070097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:08.080308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 968/1900] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:08.085184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.096310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8b3e0-6158-4b2d-a429-c835954baac8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.101638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.102853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.103143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.103423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.104186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:08.104541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.106232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.121946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 933/1901] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:08.126737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.144897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7f3f-3e83-41e1-a4ab-662aa61c094a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.150674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.151613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.152099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.152585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.153520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.155715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.192438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 969/1902] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/projects => generated 400 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:08.199518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.222275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841d2d2-9857-42d7-85f0-f1d52bf5ff58 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.321342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.322077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.322477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.322882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.323769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.325943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.358133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 934/1903] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:08.363898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.384504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5604cd-f15b-4b04-9a98-95bb0a4e019c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.396207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.397372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.397866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.398654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.400247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.403362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.426026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 970/1904] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:08.434063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.454118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b3dcf7-e8c0-4536-9436-d0e9dc56744e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.463582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.464916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.465498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.466073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.467568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.470868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05147d1-419a-4e4f-ab66-7981c521cf46 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.492268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 935/1905] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:08 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:08.496947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.511985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65502809-8592-4eec-b822-bb72ac8acddd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.518308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.519904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.520297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.520712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] PATH_INFO: `/v3/projects/d197c7df67d14f31bfc19ad7c26fae48/users/f25503c88f8640efad58f3cbcf8730dc/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.543640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d197c7df67d14f31bfc19ad7c26fae48, user_id=f25503c88f8640efad58f3cbcf8730dc, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.546817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.567201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 971/1906] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:08 2022] PUT /identity/v3/projects/d197c7df67d14f31bfc19ad7c26fae48/users/f25503c88f8640efad58f3cbcf8730dc/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:08.582388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.582872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.583503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.624573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] MFA Rules not processed for user `f25503c88f8640efad58f3cbcf8730dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:08.626432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:08.748303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 936/1907] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:08.753898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.820409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:08.850574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf068a6-bfe8-4819-b907-8e4536d9bce2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.859331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:08.860534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:08.860972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:08.861447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:08.862740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:08.866549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:08.908654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 972/1908] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/projects => generated 400 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:08.914434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:08.927104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c7675-2af0-40fc-9c3b-3087bafff612 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:08.943400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:09.014596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.015310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.015596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.015877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.016804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.018826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.042101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 937/1909] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:08 2022] POST /identity/v3/users => generated 307 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:09.046673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.058702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab864a9-b193-432d-979c-5f3595ef6455 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.064118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.064844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.065136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.065422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.066185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.068217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.080750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 973/1910] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:09.085269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.097234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a145b9-69ad-4b25-9a94-7ecd1d6af35a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.102997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.103920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.104205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.104516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] PATH_INFO: `/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65/users/000f748d24db41bc9fd80fe529d03774/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.123450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac5a1ae683d44539deaa44dfe7b3a65, user_id=000f748d24db41bc9fd80fe529d03774, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.126339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.142530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 938/1911] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:09 2022] PUT /identity/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65/users/000f748d24db41bc9fd80fe529d03774/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:09.147049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.167272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42c365-7bba-41c0-94a0-f9b76df5e8ef admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.290884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.291792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.292243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.292785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.293796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.295638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed766b-b973-4341-a9b3-91b297477f8b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.323443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 974/1912] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/roles => generated 1427 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:09.325393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.348591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c33af4f-a785-4743-8cc3-08ab9926a907 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.360020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.361467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.362225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.362751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] PATH_INFO: `/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65/users/000f748d24db41bc9fd80fe529d03774/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.366143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fac5a1ae683d44539deaa44dfe7b3a65, user_id=000f748d24db41bc9fd80fe529d03774, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.369851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.393462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 939/1913] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:09 2022] PUT /identity/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65/users/000f748d24db41bc9fd80fe529d03774/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:09.412997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.413367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.413706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.454793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] MFA Rules not processed for user `000f748d24db41bc9fd80fe529d03774`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:09.456942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:09.579811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 975/1914] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:09.593012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.594978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:09.701205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c87ed96-47bd-42ea-81af-bafb0d6b7b09 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.709101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.710265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.710739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.711197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:09.726544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:09.728659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:09.743178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 940/1915] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:09.918751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:09.931552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d1faa-4409-4f91-9e06-200ce60df0fa None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:09.936804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:09.937803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:09.938644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:09.939191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:10.009779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:10.048795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:10.052423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327be139-fb54-4f97-ae88-ce969ad64cc1 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:10.075269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 976/1916] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:13.681748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:13.683803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:13.778232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8db844-8655-40e4-93c8-7b243426a0f8 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:13.786161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:13.787658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.788162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.788668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] PATH_INFO: `/v3/users/b9a21cf57bbe40c88119da70b2d3e337` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.791098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a21cf57bbe40c88119da70b2d3e337)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:13.795060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:13.818970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:13.888933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a21cf57bbe40c88119da70b2d3e337'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:13.890219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a21cf57bbe40c88119da70b2d3e337'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:13.909097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a21cf57bbe40c88119da70b2d3e337'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:13.920347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a21cf57bbe40c88119da70b2d3e337'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:13.935035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a21cf57bbe40c88119da70b2d3e337'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:13.947563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 941/1917] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:13 2022] DELETE /identity/v3/users/b9a21cf57bbe40c88119da70b2d3e337 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:13.954899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:13.955739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:13.956572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:13.983352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:13.985222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:14.108167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 977/1918] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:14.126466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:14.128304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:14.245662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c20ca2-3897-4b32-9a93-c999adebac16 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:14.255850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:14.256583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.256874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.258146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.277770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:14.280527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:14.317968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 942/1919] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:14.912741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:14.916163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:14.938378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a63ca-1b8d-40e4-bf82-4479773ce8ae None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:14.968354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:14.970744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:14.971447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:14.972117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] PATH_INFO: `/v3/projects/17ec6aa33dbb451e8b1114b0e7d9b49f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:14.976421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ec6aa33dbb451e8b1114b0e7d9b49f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:14.980936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.143596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ec6aa33dbb451e8b1114b0e7d9b49f', 'request_id': 'req-ea772924-a5c7-4d02-96c8-568b264ffe19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.165157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ec6aa33dbb451e8b1114b0e7d9b49f', 'request_id': 'req-ea772924-a5c7-4d02-96c8-568b264ffe19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.180832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ec6aa33dbb451e8b1114b0e7d9b49f', 'request_id': 'req-ea772924-a5c7-4d02-96c8-568b264ffe19'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.205392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] The token cache is being invalidate because project 17ec6aa33dbb451e8b1114b0e7d9b49f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:15.205898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.207047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.209924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 978/1920] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:14 2022] DELETE /identity/v3/projects/17ec6aa33dbb451e8b1114b0e7d9b49f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:15.219914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.239819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71a989-c7ac-4916-a61a-04bfd194079c service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.344523 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.345916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.346258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.346551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] PATH_INFO: `/v3/users/1423947d380147029ac23c6afa7621b6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.348773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1423947d380147029ac23c6afa7621b6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.350920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.437162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.470659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1423947d380147029ac23c6afa7621b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.472407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1423947d380147029ac23c6afa7621b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.497058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1423947d380147029ac23c6afa7621b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.529167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1423947d380147029ac23c6afa7621b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.532852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.535188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:15.540730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1423947d380147029ac23c6afa7621b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:15.549668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 943/1921] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:15 2022] DELETE /identity/v3/users/1423947d380147029ac23c6afa7621b6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:15.628050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea772924-a5c7-4d02-96c8-568b264ffe19 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:15.655478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:15.716340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:15.717965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:15.718279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:15.718566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:15.720891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:15.801461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:15.803194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc06014-25f7-43fc-8865-b8f4bec162e3 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:15.815648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 979/1922] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:15.994014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:15.997272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:16.257826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662874-6371-45d7-a503-8c560bb3a885 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.276982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.279213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.279814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.280312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] PATH_INFO: `/v3/projects/4f2d23d12d254b8e9a0925194e2180c8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.299853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f2d23d12d254b8e9a0925194e2180c8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.302435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.448305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f2d23d12d254b8e9a0925194e2180c8', 'request_id': 'req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:16.467611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f2d23d12d254b8e9a0925194e2180c8', 'request_id': 'req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:16.497031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f2d23d12d254b8e9a0925194e2180c8', 'request_id': 'req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:16.534499 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] The token cache is being invalidate because project 4f2d23d12d254b8e9a0925194e2180c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:16.535222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:16.536705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c1b9c05d-b70f-41e3-8ff3-48c6dee0e789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:16.540513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 944/1923] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:15 2022] DELETE /identity/v3/projects/4f2d23d12d254b8e9a0925194e2180c8 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:16.549523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.550490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.550490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.605608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:16.607978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:16.834349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 980/1924] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:16.837438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.837947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.838496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.867014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:16.869901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:16.895668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 945/1925] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:16.902105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.917581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ac171-cfb6-4ca2-8522-4d6e683a57a0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.925742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.926799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.927774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.927774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.928358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:16.928786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.932248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.958343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 981/1926] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:16.964143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.977801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24850856-478c-475c-9f63-3b46093ec8a3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:16.985157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:16.985960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:16.986321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:16.987795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:16.988659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:16.990770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:16.994621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:16.997164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:17.037786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41bba1-7698-4071-909e-fc8c2f9c6414 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.057146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.058682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.059698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.060210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] PATH_INFO: `/v3/users/f25503c88f8640efad58f3cbcf8730dc` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.062869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25503c88f8640efad58f3cbcf8730dc)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.066820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.068205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 946/1927] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:16 2022] POST /identity/v3/projects => generated 410 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:17.073955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.114298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:17.184627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25503c88f8640efad58f3cbcf8730dc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:17.199221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:17.218869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25503c88f8640efad58f3cbcf8730dc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:17.238566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25503c88f8640efad58f3cbcf8730dc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:17.241206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25503c88f8640efad58f3cbcf8730dc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:17.242711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11614b43-69a3-4b02-a53a-11b243e4e83f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25503c88f8640efad58f3cbcf8730dc'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:17.257862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e27ee-0270-4d1a-9d94-51b114727965 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.270964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.272158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.275146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.275374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.278431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.282939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.288735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 982/1928] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:16 2022] DELETE /identity/v3/users/f25503c88f8640efad58f3cbcf8730dc => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:17.296126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.305215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.306968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.334088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 947/1929] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:17 2022] POST /identity/v3/users => generated 306 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:17.339653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.339972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:17.341258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:17.342800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:17.362351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd88a71-7378-422f-8408-7a5f046c3ea3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.455286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.456577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.457251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.457546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.458347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.464176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.490998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 983/1930] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:17.492395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 948/1931] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:17 2022] GET /identity/v3/roles => generated 1427 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:17.496706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.518992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.519461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ef8fb-36fe-44ce-8b4c-832eaf3901e7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.520996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:17.548589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.551253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.553479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.554076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.556288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.560828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.584462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 984/1932] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:17 2022] GET /identity/v3/roles => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:17.588534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:17.609207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f08b66-f003-4602-969d-b55c53482b99 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.619185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.621845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.622520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.623096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] PATH_INFO: `/v3/projects/393327d51d804763adb850d5aa42d654/users/f7ce3040c9bd430fb869b17e326cc6ba/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.627624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4511ef-6102-423d-aad8-2ccfd12eccfa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:17.636024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:17.636752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.637051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.637338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.648665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393327d51d804763adb850d5aa42d654, user_id=f7ce3040c9bd430fb869b17e326cc6ba, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.649307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:17.650930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1a4894-50f5-457e-a9f0-481d51e27113 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.651492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:17.665824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 949/1933] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:17.670247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 985/1934] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:17 2022] PUT /identity/v3/projects/393327d51d804763adb850d5aa42d654/users/f7ce3040c9bd430fb869b17e326cc6ba/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:17.689256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:17.689869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:17.690424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:17.733719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] MFA Rules not processed for user `f7ce3040c9bd430fb869b17e326cc6ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:17.735380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:17.801949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:17.872080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 950/1935] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:17.874481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.001700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751c5cd-d568-4d7b-b586-3f8940b9e598 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.008740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.009625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.010066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.010503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.011383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.013784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.050256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 986/1936] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:17 2022] POST /identity/v3/projects => generated 410 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:18.058180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.101000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0be951-3636-4707-81a8-5cf36ba3890c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.342290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.343520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.347777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.348017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.350173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:18.353393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.360100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.368514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.392089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede345c-158b-4a78-b936-283dce914548 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.404780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.407857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.408790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.409261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] PATH_INFO: `/v3/projects/d197c7df67d14f31bfc19ad7c26fae48` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.411740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d197c7df67d14f31bfc19ad7c26fae48)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.417449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.446867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 951/1937] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:18 2022] POST /identity/v3/users => generated 312 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:18.450460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.462422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0f7c9-adc4-4f06-99bc-6626b2cfc69e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.467659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.468404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.468794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.469074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.469849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.471748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.477002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:18.485822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 952/1938] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:18.491265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.517343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527be36-9eb2-4481-86e6-f4892f401316 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.548752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd197c7df67d14f31bfc19ad7c26fae48', 'request_id': 'req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:18.563134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd197c7df67d14f31bfc19ad7c26fae48', 'request_id': 'req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:18.578868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd197c7df67d14f31bfc19ad7c26fae48', 'request_id': 'req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:18.599652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] The token cache is being invalidate because project d197c7df67d14f31bfc19ad7c26fae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:18.600008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:18.601750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:18.603787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 987/1939] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:18 2022] DELETE /identity/v3/projects/d197c7df67d14f31bfc19ad7c26fae48 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:18.610909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.614085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:18.656476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.657922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.658451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.659216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] PATH_INFO: `/v3/projects/cda46a0bf9424fe5984e35c383ae682e/users/868225575fb04ebab29c633dbf859e98/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.702417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda46a0bf9424fe5984e35c383ae682e, user_id=868225575fb04ebab29c633dbf859e98, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.708959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.739357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 953/1940] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:18 2022] PUT /identity/v3/projects/cda46a0bf9424fe5984e35c383ae682e/users/868225575fb04ebab29c633dbf859e98/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:18.744959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.748809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:18.777142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e19a3a-3d8a-459f-8578-0ef1baa6da0f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.829732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:18.878751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.879975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.880404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.880787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] PATH_INFO: `/v3/users/000f748d24db41bc9fd80fe529d03774` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.881257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c53dd-2a2a-46d7-adc9-eb7bd1eeb9cb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.882448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=000f748d24db41bc9fd80fe529d03774)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.885187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.890068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.891098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.891724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.892426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.893688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.896787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.922266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 954/1941] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:18 2022] GET /identity/v3/roles => generated 1427 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:18.927882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:18.949759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535d5dc-ad1c-4ba6-802a-cd63d312f17e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:18.957944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:18.959995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.960566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.961207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] PATH_INFO: `/v3/projects/cda46a0bf9424fe5984e35c383ae682e/users/868225575fb04ebab29c633dbf859e98/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:18.967458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda46a0bf9424fe5984e35c383ae682e, user_id=868225575fb04ebab29c633dbf859e98, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:18.970778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5e9e1-bbf6-4207-9226-6b42ca6e1773 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:18.985911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 955/1942] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:18 2022] PUT /identity/v3/projects/cda46a0bf9424fe5984e35c383ae682e/users/868225575fb04ebab29c633dbf859e98/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:18.998454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:18.999274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:18.999801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.008325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '000f748d24db41bc9fd80fe529d03774'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:19.025310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.069938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '000f748d24db41bc9fd80fe529d03774'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:19.089909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '000f748d24db41bc9fd80fe529d03774'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:19.091894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '000f748d24db41bc9fd80fe529d03774'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:19.093392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] MFA Rules not processed for user `868225575fb04ebab29c633dbf859e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:19.094377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '000f748d24db41bc9fd80fe529d03774'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:19.098695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:19.126377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 988/1943] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:18 2022] DELETE /identity/v3/users/000f748d24db41bc9fd80fe529d03774 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:19.302270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 956/1944] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:19.358657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.360584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:19.464717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.466365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:19.573925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dd030-caf4-4cf9-b02c-1e8bf66d0f9f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.584569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.585851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.586486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.589772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.646748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e6e0d-e1fd-437c-a3dc-c07227a40f05 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:19.776111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.780717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.817454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 989/1945] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:19.848616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:19.884513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:19.886484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:19.887088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:19.888785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] PATH_INFO: `/v3/users/8e0910bbd0e843c284a247e6ccefc929` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:19.894264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0910bbd0e843c284a247e6ccefc929)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:19.903991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:19.971783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:19.974650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.047909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a59e1b-becb-4164-8c11-39a83e44034e service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.057898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.059204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.059812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.060215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] PATH_INFO: `/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.063539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fac5a1ae683d44539deaa44dfe7b3a65)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.069973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.070809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0910bbd0e843c284a247e6ccefc929'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.071691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0910bbd0e843c284a247e6ccefc929'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.094292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0910bbd0e843c284a247e6ccefc929'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.110927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0910bbd0e843c284a247e6ccefc929'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.123342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4e235f-bf0a-4f48-b6e2-33924bdedc04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0910bbd0e843c284a247e6ccefc929'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.134305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 957/1946] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:19 2022] DELETE /identity/v3/users/8e0910bbd0e843c284a247e6ccefc929 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:20.140920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed9d6-3b71-40be-a9ef-feeb4ff8b512 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.142105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed9d6-3b71-40be-a9ef-feeb4ff8b512 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.142579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ed9d6-3b71-40be-a9ef-feeb4ff8b512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.172386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dc9ed9d6-3b71-40be-a9ef-feeb4ff8b512 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:20.176442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc9ed9d6-3b71-40be-a9ef-feeb4ff8b512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.201222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fac5a1ae683d44539deaa44dfe7b3a65', 'request_id': 'req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.238637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fac5a1ae683d44539deaa44dfe7b3a65', 'request_id': 'req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.269486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fac5a1ae683d44539deaa44dfe7b3a65', 'request_id': 'req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.288022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] The token cache is being invalidate because project fac5a1ae683d44539deaa44dfe7b3a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:20.288513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.289419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:20.291561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 990/1947] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:19 2022] DELETE /identity/v3/projects/fac5a1ae683d44539deaa44dfe7b3a65 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:20.292674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.294289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.304548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 958/1948] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:20.305123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.311917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.311917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.311917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.357698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:20.360450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.381996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 959/1949] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:20.384136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.387419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.461158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07af2d-13a6-41b6-806a-40dc1c95d3c6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.468974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.470429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.471050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.471716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.475040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.511633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d27b6-dfa4-4d87-b8ab-c73abf5b225a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.527084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.528516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.528886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.529295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.532609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.555276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.557447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6691e9-1819-414c-9304-6b19bd026cb1 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.569892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 960/1950] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:20.571683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.572031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.572984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.597301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:20.603076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:20.605514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:20.622823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.624492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 961/1951] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:20.625451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.625673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.636542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601c739-419b-416c-af4a-44d23ea2a1fa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.640487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 991/1952] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:20.642575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.643257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.644454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.644454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.644765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:20.645055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.646824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.664626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 962/1953] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:20 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:20.668830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.689083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1f063-b673-4191-8b64-a0c01b664a5f service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.699417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.700963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.701944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.702714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.704260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.711434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:20.761618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 992/1954] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/projects => generated 388 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:20.762740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:20.805433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359333-3811-4375-af8b-92d05a4e5af5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:20.962114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:20.963279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:20.963626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:20.963912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:20.964684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:20.966736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.004488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 963/1955] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:20 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:21.010806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.024940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d9de3-79a3-443c-bdd4-b16184a9be6c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.030374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.031205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.031559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.031746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.032540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.034416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.050021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 993/1956] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:21.054414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.066833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd385cd-020e-4462-99d1-92776dd533da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.073904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.074812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.074980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.075294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.076077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.078290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb7389-6a2d-4bc3-88e3-262902198701 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.095340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 964/1957] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:21 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:21.100733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.114620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322db6f9-73c1-427e-a1ad-4400c22ae07f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.122103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.123036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.123416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.123660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] PATH_INFO: `/v3/projects/90a0e10af65f4a26bb34d745f26de592/users/c69d4771bd14481094cdeaea5adfc637/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.148105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a0e10af65f4a26bb34d745f26de592, user_id=c69d4771bd14481094cdeaea5adfc637, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.151194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.193925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 994/1958] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:21 2022] PUT /identity/v3/projects/90a0e10af65f4a26bb34d745f26de592/users/c69d4771bd14481094cdeaea5adfc637/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:21.208557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.210387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.211245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.302868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] MFA Rules not processed for user `c69d4771bd14481094cdeaea5adfc637`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:21.306110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:21.452682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.453656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 965/1959] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:21.459782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.460057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:21.595584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a3a6a-27dc-47aa-8b32-3e1051240465 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.602356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.605916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.608754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.610394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.610753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] PATH_INFO: `/v3/projects/9bb5c7a93c6d4d76a27cbb10c2b5b79c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.614117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb5c7a93c6d4d76a27cbb10c2b5b79c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.617583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.619251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b523ad-04e1-4aeb-9c92-5b9313ac1484 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.625743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:21.629388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.630197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.631371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.631727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.632896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.636453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:21.688418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 966/1960] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:21 2022] POST /identity/v3/projects => generated 390 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:21.694575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.734327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb5c7a93c6d4d76a27cbb10c2b5b79c', 'request_id': 'req-faefe0cf-843f-4d54-b42d-5502a021b7c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:21.751987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb5c7a93c6d4d76a27cbb10c2b5b79c', 'request_id': 'req-faefe0cf-843f-4d54-b42d-5502a021b7c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:21.756826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb5c7a93c6d4d76a27cbb10c2b5b79c', 'request_id': 'req-faefe0cf-843f-4d54-b42d-5502a021b7c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:21.772150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] The token cache is being invalidate because project 9bb5c7a93c6d4d76a27cbb10c2b5b79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:21.772746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:21.773558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:21.776316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 995/1961] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:21 2022] DELETE /identity/v3/projects/9bb5c7a93c6d4d76a27cbb10c2b5b79c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:21.782501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:21.786554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:21.834332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd10603-c8a2-49b1-8cae-8513f7f450c1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.960115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefe0cf-843f-4d54-b42d-5502a021b7c5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:21.976756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:21.978826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:21.979732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:21.982590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] PATH_INFO: `/v3/users/70a6d22ea17e49ce96422db91da55fbb` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:21.985333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a6d22ea17e49ce96422db91da55fbb)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:21.988530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.029020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.030288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.031026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.031642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.033161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.037101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.079310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 967/1962] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:21 2022] POST /identity/v3/users => generated 302 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:22.084489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.093530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.116195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce8328-ab7e-4d1c-a760-83630469bdf7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.135439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.135439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.135439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.135439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.135924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.135924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.142879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a6d22ea17e49ce96422db91da55fbb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:22.148913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 968/1963] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:22.151207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.165752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772822-a105-4fd3-b514-6f2b9620aae4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.166751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a6d22ea17e49ce96422db91da55fbb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:22.171858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.173200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.173655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.174123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] PATH_INFO: `/v3/projects/069dd6a897b445628cf9bf83e65e449a/users/7e81ed04e888453f835ba50d3d53930d/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.177396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a6d22ea17e49ce96422db91da55fbb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:22.177799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a6d22ea17e49ce96422db91da55fbb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:22.178436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a6d22ea17e49ce96422db91da55fbb'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:22.198278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 996/1964] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:21 2022] DELETE /identity/v3/users/70a6d22ea17e49ce96422db91da55fbb => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:22.203770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=069dd6a897b445628cf9bf83e65e449a, user_id=7e81ed04e888453f835ba50d3d53930d, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.208858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.233272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 969/1965] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:22 2022] PUT /identity/v3/projects/069dd6a897b445628cf9bf83e65e449a/users/7e81ed04e888453f835ba50d3d53930d/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:22.237963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.239750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.269268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.382099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b067da-7e76-4bea-85d3-e8425a2b6d93 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.490559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.493338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.493889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.494404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.496509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.499127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef254c-e320-490c-9ac9-f3a0f2d346f2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.517555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 997/1966] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/roles => generated 1427 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:22.521725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.537907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed184-5aa3-44a8-a7e3-8ec5e87d17ca admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.543403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.544335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.544728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.545017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] PATH_INFO: `/v3/projects/069dd6a897b445628cf9bf83e65e449a/users/7e81ed04e888453f835ba50d3d53930d/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.547508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=069dd6a897b445628cf9bf83e65e449a, user_id=7e81ed04e888453f835ba50d3d53930d, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.550361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.566045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 970/1967] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:22 2022] PUT /identity/v3/projects/069dd6a897b445628cf9bf83e65e449a/users/7e81ed04e888453f835ba50d3d53930d/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:22.584750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.585253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.585970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.638530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] MFA Rules not processed for user `7e81ed04e888453f835ba50d3d53930d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:22.640211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.694330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.697235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.782634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 998/1968] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:22.805193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:22.810231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:22.821840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.900674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f4c57-3460-4e7e-9d6a-13522f92f839 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.907657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:22.914332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.916823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.917492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.918121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] PATH_INFO: `/v3/projects/9712ce03e8524d739da56c30cc805c91` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.923243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9712ce03e8524d739da56c30cc805c91)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:22.927343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:22.952691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee725c-5478-4a28-93e0-1afbadc39e77 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:22.961382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:22.963194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:22.963979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:22.964754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:22.999790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.009781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.032776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 999/1969] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:23.053160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9712ce03e8524d739da56c30cc805c91', 'request_id': 'req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.069586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9712ce03e8524d739da56c30cc805c91', 'request_id': 'req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.089240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9712ce03e8524d739da56c30cc805c91', 'request_id': 'req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.122826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] The token cache is being invalidate because project 9712ce03e8524d739da56c30cc805c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:23.123354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.126166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.131933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 971/1970] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:22 2022] DELETE /identity/v3/projects/9712ce03e8524d739da56c30cc805c91 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:23.134222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.155108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc77d9-9cc2-4b6a-8833-a6cbc564d8ed service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.332349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:23.334943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:23.388407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.389373 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.389692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.389980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] PATH_INFO: `/v3/users/f3dce16b3e274519b3db453ee61c2747` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.392260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3dce16b3e274519b3db453ee61c2747)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.393882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.483315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3dce16b3e274519b3db453ee61c2747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.522551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b5149-70a6-4f19-85cc-8c4e2a6e4abb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:23.531698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3dce16b3e274519b3db453ee61c2747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.550596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:23.554960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3dce16b3e274519b3db453ee61c2747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.555177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.556251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3dce16b3e274519b3db453ee61c2747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.556396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.557280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-54da9709-98aa-4e90-bfd0-2b9a51ea22bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3dce16b3e274519b3db453ee61c2747'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.557439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] PATH_INFO: `/v3/users/c69d4771bd14481094cdeaea5adfc637` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.564461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69d4771bd14481094cdeaea5adfc637)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:23.574525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:23.603196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1000/1971] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:23 2022] DELETE /identity/v3/users/f3dce16b3e274519b3db453ee61c2747 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:23.780419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69d4771bd14481094cdeaea5adfc637'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.781557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69d4771bd14481094cdeaea5adfc637'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.810111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:23.814303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69d4771bd14481094cdeaea5adfc637'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.840949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69d4771bd14481094cdeaea5adfc637'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.853100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69d4771bd14481094cdeaea5adfc637'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:23.866549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 972/1972] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:23 2022] DELETE /identity/v3/users/c69d4771bd14481094cdeaea5adfc637 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:23.873179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:23.874080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:23.874674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:23.948159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:23.950067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.065242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1001/1973] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:24.084467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.086466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.222498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8718-1081-4a86-aab8-ceed241c082b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.229970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.231599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.232112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.232651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.252471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.265581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0793-1cb7-477d-8256-70cb9420d831 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.303881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 973/1974] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:24.350380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.353176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.363749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:24.385992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04475d-cc9d-4319-b304-f770737748ea None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.410157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.411959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.412597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.413060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] PATH_INFO: `/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.416100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eb7af437db49c3a27ed96ca5a219ef)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.419805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.509828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eb7af437db49c3a27ed96ca5a219ef', 'request_id': 'req-f2723b0f-9610-4bc7-89b2-206c082ddd36'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:24.525550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eb7af437db49c3a27ed96ca5a219ef', 'request_id': 'req-f2723b0f-9610-4bc7-89b2-206c082ddd36'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:24.542298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eb7af437db49c3a27ed96ca5a219ef', 'request_id': 'req-f2723b0f-9610-4bc7-89b2-206c082ddd36'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:24.561984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] The token cache is being invalidate because project b8eb7af437db49c3a27ed96ca5a219ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:24.562269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:24.562981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f2723b0f-9610-4bc7-89b2-206c082ddd36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:24.565664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1002/1975] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:24 2022] DELETE /identity/v3/projects/b8eb7af437db49c3a27ed96ca5a219ef => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:24.574255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.575084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.575937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.616088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:24.619182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.751813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 974/1976] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:24.763488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926904-53cc-4283-a719-d625f864f567 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.764315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926904-53cc-4283-a719-d625f864f567 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.765157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1926904-53cc-4283-a719-d625f864f567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.807364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d1926904-53cc-4283-a719-d625f864f567 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:24.809870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d1926904-53cc-4283-a719-d625f864f567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:24.828867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1003/1977] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:24.833179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.845593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc208-c312-44a5-885a-ddcbece7dd23 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.864663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.865215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.865511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.865803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.866928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:24.866928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.869189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.899233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 975/1978] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:24.900869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1926904-53cc-4283-a719-d625f864f567 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:24.929206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1926904-53cc-4283-a719-d625f864f567 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:24.962527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:24.962527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:24.962978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:24.963470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:24.967654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:24.982677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:24.998755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.001290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.027939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85781284-c97b-4111-b1c0-b39aad2412af admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.037412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.041857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.042525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.043015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] PATH_INFO: `/v3/projects/90a0e10af65f4a26bb34d745f26de592` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.045485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a0e10af65f4a26bb34d745f26de592)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.051685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.225344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a0e10af65f4a26bb34d745f26de592', 'request_id': 'req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.233153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1004/1979] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:24 2022] POST /identity/v3/projects => generated 384 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:25.238571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.241966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a0e10af65f4a26bb34d745f26de592', 'request_id': 'req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.248983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.256504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a0e10af65f4a26bb34d745f26de592', 'request_id': 'req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.272147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] The token cache is being invalidate because project 90a0e10af65f4a26bb34d745f26de592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:25.272579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.273466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.279108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 976/1980] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:24 2022] DELETE /identity/v3/projects/90a0e10af65f4a26bb34d745f26de592 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:25.281565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.284006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.419814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6066eb5-cd75-4208-a3a2-ee321f4c7dd6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.437531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.439148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.439665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.441886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac068657-40cd-4f1d-8192-3372791e4263 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.442911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] PATH_INFO: `/v3/users/7e81ed04e888453f835ba50d3d53930d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.446946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e81ed04e888453f835ba50d3d53930d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.452400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.455212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.457579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.458442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.459799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.463217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.472287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.561688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1005/1981] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:25.563665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.568213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.586361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e81ed04e888453f835ba50d3d53930d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.588125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e81ed04e888453f835ba50d3d53930d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.595415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0ddf8-7dde-41cf-a6e8-bb7950a3daed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.603963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.605077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.605465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.605851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.607161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.609520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.610124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e81ed04e888453f835ba50d3d53930d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.623062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1006/1982] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/roles => generated 1427 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:25.624861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e81ed04e888453f835ba50d3d53930d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.628081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.635996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e81ed04e888453f835ba50d3d53930d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:25.640483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f359f5-1fb4-4d7c-a943-7d2a19a6e378 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.645618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 977/1983] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:25 2022] DELETE /identity/v3/users/7e81ed04e888453f835ba50d3d53930d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:25.646044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.646880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.647190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.647853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.649017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.651320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf23b4-cfb7-4d63-9cd2-94eb43eb1a70 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.678139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1007/1984] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:25 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:25.682475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:25.684659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.796851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2accba-74db-411c-b6ea-774d43d3668b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:25.803495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:25.805016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.805016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.805491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] PATH_INFO: `/v3/projects/c20380c44a6b4ffea210986c393f46ed/users/5edcca329dcc4b998532844932b543e3/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.829675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20380c44a6b4ffea210986c393f46ed, user_id=5edcca329dcc4b998532844932b543e3, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:25.840389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:25.845424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:25.872549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 978/1985] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:25 2022] PUT /identity/v3/projects/c20380c44a6b4ffea210986c393f46ed/users/5edcca329dcc4b998532844932b543e3/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:25.892273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:25.892900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:25.893433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:25.945790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] MFA Rules not processed for user `5edcca329dcc4b998532844932b543e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:25.948334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:25.987180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.098313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1008/1986] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:26.104968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.197546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.201696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.256057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cb9aa-3a45-4bf2-b8aa-cc6bce44dfdf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.268403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.269291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.269736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.270165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.271130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.278148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.339525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 979/1987] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/projects => generated 380 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:26.345195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.393142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e6c2d-e1be-43c0-8cf4-7c7221abcda0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.493634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.494562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.494851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.495135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] PATH_INFO: `/v3/projects/069dd6a897b445628cf9bf83e65e449a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.496887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=069dd6a897b445628cf9bf83e65e449a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.499364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.507233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20537ea2-7159-4772-8df3-bd7b766fa6d3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.519863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.520978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.521274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.521560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.523226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.525601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.560751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 980/1988] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:26.565975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.583571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f592c3-d3e4-4b3b-87d1-ac951f8f4267 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.590800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.591670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.592023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.592387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.593226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.595274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.608948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 981/1989] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:26.614921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.637813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069dd6a897b445628cf9bf83e65e449a', 'request_id': 'req-da0e7356-e242-4623-8150-3f00f8d4e8ce'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:26.643170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0239fb3-77b7-4099-bbd1-d970dc745ec7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.652942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069dd6a897b445628cf9bf83e65e449a', 'request_id': 'req-da0e7356-e242-4623-8150-3f00f8d4e8ce'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:26.669095 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069dd6a897b445628cf9bf83e65e449a', 'request_id': 'req-da0e7356-e242-4623-8150-3f00f8d4e8ce'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:26.676354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.697107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] The token cache is being invalidate because project 069dd6a897b445628cf9bf83e65e449a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:26.698271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:26.700232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-da0e7356-e242-4623-8150-3f00f8d4e8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:26.702968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1009/1990] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:26 2022] DELETE /identity/v3/projects/069dd6a897b445628cf9bf83e65e449a => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:26.708331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab46ca-e895-4e55-8b47-750a31fcce21 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.708810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab46ca-e895-4e55-8b47-750a31fcce21 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.709204 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab46ca-e895-4e55-8b47-750a31fcce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.718054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:26.726936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.728802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.729084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.729669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] PATH_INFO: `/v3/projects/d1d89ffdd3624a04ac78828e57db037b/users/87fcb5a934874d13a6ba409117b5a441/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.734583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dfab46ca-e895-4e55-8b47-750a31fcce21 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:26.736088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dfab46ca-e895-4e55-8b47-750a31fcce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.748607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1010/1991] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:26.753262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d89ffdd3624a04ac78828e57db037b, user_id=87fcb5a934874d13a6ba409117b5a441, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.756231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.756975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.757460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.757949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.776907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 982/1992] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:26 2022] PUT /identity/v3/projects/d1d89ffdd3624a04ac78828e57db037b/users/87fcb5a934874d13a6ba409117b5a441/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:26.780361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:26.781288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.781707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.784087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:26.874240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1011/1993] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:26.880469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.892262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231f980-2647-4ad4-9f8d-4f65e65ed75d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.895550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c08a0-ee6e-4533-b437-f9a25998d7cc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.897467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.898239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.898601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.898954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.900446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:26.900837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.902633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.904550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.905731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.906208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.906713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.908181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.911377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.920615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1012/1994] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:26.921790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.932320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc36ec3-0392-4e42-9995-c0f1a218a35a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.936708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 983/1995] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:26 2022] GET /identity/v3/roles => generated 1427 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:26.938549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:26.944357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.945440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.945921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.946498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.947641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.950616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32afb9-3229-4a13-8c59-b2ad585c4778 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.956888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e268208-2e94-4236-895b-854cbfc4edf8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:26.965012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:26.966506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:26.966967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:26.967444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] PATH_INFO: `/v3/projects/d1d89ffdd3624a04ac78828e57db037b/users/87fcb5a934874d13a6ba409117b5a441/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:26.971236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d89ffdd3624a04ac78828e57db037b, user_id=87fcb5a934874d13a6ba409117b5a441, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:26.976191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:26.996068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 984/1996] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:26 2022] PUT /identity/v3/projects/d1d89ffdd3624a04ac78828e57db037b/users/87fcb5a934874d13a6ba409117b5a441/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:27.002242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1013/1997] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:26 2022] POST /identity/v3/projects => generated 372 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:27.006304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.010819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.011252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.011917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.047506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] MFA Rules not processed for user `87fcb5a934874d13a6ba409117b5a441`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.049155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.110599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b6c16-39af-4d82-9ff0-4a32f2979eb6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.152687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1014/1998] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:27.172015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.174026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.199742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.200859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.201279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.201562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.202864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.205894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.233237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.241924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:27.253036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 985/1999] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:27.259717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.288413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d96ba-7301-4425-a5c7-d4b7587288a1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.299394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698294db-7fbe-40c2-bfdb-c6ae1a49c7de None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.310797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.312155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.312828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.313498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.323769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.324298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.324865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.325392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.326954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.332722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.340559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.345080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.364190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1015/2000] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:27.372559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 986/2001] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:27.380207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.417815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d620ae-c757-48f9-a9c0-4546c247e4ca service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.429335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.430741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.431294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.431843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.433460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.437088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.477282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1016/2002] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:27.479305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.498569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b995-44ba-4e8d-9769-4f1bb2e27b26 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.509649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.512109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.512775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.514037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] PATH_INFO: `/v3/projects/9f81bd02cdf94ff98c1e9534199b425c/users/9c0fb73a262843f89285a6e161a1abed/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.549879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f81bd02cdf94ff98c1e9534199b425c, user_id=9c0fb73a262843f89285a6e161a1abed, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.550355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.555322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536ace9-9ca5-406b-a646-842a004c3e2e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.566522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d63f839-6ecc-40f3-b4f1-0b37b05ee70e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.576493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 987/2003] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:27 2022] PUT /identity/v3/projects/9f81bd02cdf94ff98c1e9534199b425c/users/9c0fb73a262843f89285a6e161a1abed/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:27.581920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.582275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.582491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.602871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:27.604118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.662753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.663872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.664938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.664938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.668142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.676101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 988/2004] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:27.692969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:27.695012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:27.785114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afdf09-5f94-4b18-bfe5-78f7c73f3c9a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:27.787545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.790490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.790721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:27.791586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:27.792006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:27.792462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:27.808055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:27.809860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1017/2005] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:27.822179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d2092-27dc-4fd5-9f1a-053a9f9b82c4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:27.842483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 989/2006] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:28.333019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.360967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae1911d-74f4-407f-a5d1-4656a85f8b52 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:28.381718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:28.384313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.385409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.386161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] PATH_INFO: `/v3/users/5edcca329dcc4b998532844932b543e3` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.389168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edcca329dcc4b998532844932b543e3)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:28.393588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:28.582485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edcca329dcc4b998532844932b543e3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:28.658784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edcca329dcc4b998532844932b543e3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:28.687625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edcca329dcc4b998532844932b543e3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:28.689068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edcca329dcc4b998532844932b543e3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:28.690242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edcca329dcc4b998532844932b543e3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:28.707811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:28.739923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1018/2007] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:28 2022] DELETE /identity/v3/users/5edcca329dcc4b998532844932b543e3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:28.746978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021d09-6138-4e57-a473-51c68f606ff0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:28.747733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021d09-6138-4e57-a473-51c68f606ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:28.747733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60021d09-6138-4e57-a473-51c68f606ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:28.771328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-60021d09-6138-4e57-a473-51c68f606ff0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:28.774007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-60021d09-6138-4e57-a473-51c68f606ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:28.900710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 990/2008] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:28.912080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:28.914546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.048039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b0d8d-19f8-452d-a901-9d942ba3ba55 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.056464 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.058569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.058569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.059217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.080149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.083327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.109840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1019/2009] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:29.148601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.150091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.150770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.193298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:29.217630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] MFA Rules not processed for user `9c0fb73a262843f89285a6e161a1abed`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:29.221327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.394939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 991/2010] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:29.407403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.408995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.490633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d817-dd75-4495-9368-492375c63451 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.499316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.500515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.501025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.501515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.550091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.555377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.623769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1020/2011] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:29.730006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:29.731806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:29.768624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806841f-3ab9-4704-af72-e8fce107e08e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:29.784515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:29.785450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:29.785716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:29.785992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] PATH_INFO: `/v3/projects/c20380c44a6b4ffea210986c393f46ed` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:29.789321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20380c44a6b4ffea210986c393f46ed)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:29.793955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:29.924655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20380c44a6b4ffea210986c393f46ed', 'request_id': 'req-0cd0d918-6af9-42a0-90b6-38567e95a123'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.955770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20380c44a6b4ffea210986c393f46ed', 'request_id': 'req-0cd0d918-6af9-42a0-90b6-38567e95a123'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.970630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20380c44a6b4ffea210986c393f46ed', 'request_id': 'req-0cd0d918-6af9-42a0-90b6-38567e95a123'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.995504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] The token cache is being invalidate because project c20380c44a6b4ffea210986c393f46ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:29.995810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:29.997381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.000263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 992/2012] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:29 2022] DELETE /identity/v3/projects/c20380c44a6b4ffea210986c393f46ed => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:30.005449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.035457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f30b5d-6740-40ad-a4a5-0fd3699ff737 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.149953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.150855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.151139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.151574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] PATH_INFO: `/v3/users/87fcb5a934874d13a6ba409117b5a441` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.153669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fcb5a934874d13a6ba409117b5a441)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.158870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.239721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.248596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fcb5a934874d13a6ba409117b5a441'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.265365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fcb5a934874d13a6ba409117b5a441'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.275917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fcb5a934874d13a6ba409117b5a441'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.276687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fcb5a934874d13a6ba409117b5a441'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.277713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d807e71f-4516-4663-9eb2-686ad70f8958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fcb5a934874d13a6ba409117b5a441'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.299843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1021/2013] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:30 2022] DELETE /identity/v3/users/87fcb5a934874d13a6ba409117b5a441 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:30.717600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:30.720508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:30.773128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd0d918-6af9-42a0-90b6-38567e95a123 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:30.886790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:30.888831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:30.889417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:30.889859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] PATH_INFO: `/v3/projects/d1d89ffdd3624a04ac78828e57db037b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:30.892679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d89ffdd3624a04ac78828e57db037b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:30.901952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:30.945445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:30.974728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d89ffdd3624a04ac78828e57db037b', 'request_id': 'req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.985975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d89ffdd3624a04ac78828e57db037b', 'request_id': 'req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:30.996676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d89ffdd3624a04ac78828e57db037b', 'request_id': 'req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:31.010149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] The token cache is being invalidate because project d1d89ffdd3624a04ac78828e57db037b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:31.010457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:31.011271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2c9632f7-b84c-4839-970a-fd27f3d4d3ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:31.012946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 993/2014] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:30 2022] DELETE /identity/v3/projects/d1d89ffdd3624a04ac78828e57db037b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:31.018530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.019155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.019155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.040291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:31.041581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:31.122058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1022/2015] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:31.130429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.130753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.131052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.162314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:31.163824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:31.174313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 994/2016] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:31.178593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.191331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e6d85-d729-4de1-a56e-0ffc6b1e07e1 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.201255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.203770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.204799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.205606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.207347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:31.219295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.222434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.249887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1023/2017] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:31 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:31.257737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.276055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21a3de-b45e-4ba9-a601-8c2a7c1edd12 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.283394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.285557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.286227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.286657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.288064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.291529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.328171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 995/2018] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:31 2022] POST /identity/v3/projects => generated 374 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:31.338440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.350150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec650c8e-6d12-49ef-b29b-527a33da3dcc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.426579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.427810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.428093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.428712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.429971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.433542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.457090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1024/2019] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:31 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:31.462287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.473412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad200a-c420-4457-a6f0-ac46408f7201 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.478879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.479577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.479867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.480150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.480954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.482599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.499181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 996/2020] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:31 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:31.503524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.514840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aace0f-1a8f-4f6b-814f-442a694870ed admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.520053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.520790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.521084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.521370 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.522125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.523783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c4ea3-6d98-4c91-ac34-929b4609af0d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.538822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1025/2021] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:31 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:31.543464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.554688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31834b6-9619-4273-aa83-84104cbfe1ba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.559724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.560681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.560998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.561279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] PATH_INFO: `/v3/projects/f763553c9b12481c96cc99b71f24d841/users/755c93adb65f4f6b938f5c9c5ca9b2af/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.578366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f763553c9b12481c96cc99b71f24d841, user_id=755c93adb65f4f6b938f5c9c5ca9b2af, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.581141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.598776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 997/2022] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:31 2022] PUT /identity/v3/projects/f763553c9b12481c96cc99b71f24d841/users/755c93adb65f4f6b938f5c9c5ca9b2af/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:31.605361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f68e-91a2-43b0-962c-0c89cd03a86d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.605941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f68e-91a2-43b0-962c-0c89cd03a86d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.606285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f68e-91a2-43b0-962c-0c89cd03a86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.626383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3844f68e-91a2-43b0-962c-0c89cd03a86d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:31.627563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3844f68e-91a2-43b0-962c-0c89cd03a86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:31.657276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:31.709123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1026/2023] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:31.720874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:31.723005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:31.794902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2da39-f05f-491c-b1cc-9a10f4b04942 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:31.799065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:31.799753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:31.800075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:31.800355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:31.810727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:31.812201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aeec1c-1e6d-4b3b-a38a-e265e7716bfe service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:31.824255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 998/2024] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:32.327993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:32.328578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:32.329064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:32.352268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] MFA Rules not processed for user `9c0fb73a262843f89285a6e161a1abed`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:32.353538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:32.430092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1027/2025] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:33.137105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.138431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.138775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.189424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] MFA Rules not processed for user `755c93adb65f4f6b938f5c9c5ca9b2af`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:33.191045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:33.277982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:33.327165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 999/2026] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:33.334603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.354651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686a3cb-2f6a-49a7-aee6-7e41611c45f0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.369873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.371846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.371846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.371846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.372424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.374350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.481754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1028/2027] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/projects => generated 368 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:33.482745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.498171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c266f8e-5d19-471b-9514-23bcf2e8eb82 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.648618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.650224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.650681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.651138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.653044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.656105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.691214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1000/2028] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:33 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:33.698234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.718664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5fb6e-3033-4d45-8893-bf74e8be087a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.726851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.727638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.728322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.728646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.730935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.734513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.764404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1029/2029] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:33 2022] GET /identity/v3/roles => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:33.766236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.781962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d31c6c-c94f-4672-ad94-2e8baec3eab7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.788158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.789460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.790156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.790839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] PATH_INFO: `/v3/projects/d911c2ecaa8f474ab3b9cf735693f777/users/c6a10467d2454c1aa14b71aebdb1a329/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.816124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d911c2ecaa8f474ab3b9cf735693f777, user_id=c6a10467d2454c1aa14b71aebdb1a329, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.818380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.845631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.848862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:33.851934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1001/2030] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:33 2022] PUT /identity/v3/projects/d911c2ecaa8f474ab3b9cf735693f777/users/c6a10467d2454c1aa14b71aebdb1a329/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:33.857376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:33.879477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965724a3-8bd1-4217-80ed-38941f768377 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.951800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819f504-63df-472f-b181-163f4a10672a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:33.958156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:33.958867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:33.959165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:33.959456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:33.960218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:33.962427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:33.976084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1002/2031] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:33 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:33.983816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.002515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.002809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612a8b6-1a71-4183-b1c7-cc3a1b35ff25 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.003628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.003993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.004239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] PATH_INFO: `/v3/users/f7ce3040c9bd430fb869b17e326cc6ba` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.006081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ce3040c9bd430fb869b17e326cc6ba)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.008732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.009023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.010131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.010868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.011180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] PATH_INFO: `/v3/projects/d911c2ecaa8f474ab3b9cf735693f777/users/c6a10467d2454c1aa14b71aebdb1a329/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.014230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d911c2ecaa8f474ab3b9cf735693f777, user_id=c6a10467d2454c1aa14b71aebdb1a329, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.017881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfeee6-c418-4ef5-8784-670b41651b98 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.041593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1003/2032] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:33 2022] PUT /identity/v3/projects/d911c2ecaa8f474ab3b9cf735693f777/users/c6a10467d2454c1aa14b71aebdb1a329/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:34.076715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.089742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ce3040c9bd430fb869b17e326cc6ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.108852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ce3040c9bd430fb869b17e326cc6ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.120180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ce3040c9bd430fb869b17e326cc6ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.123021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ce3040c9bd430fb869b17e326cc6ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.124178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ce3040c9bd430fb869b17e326cc6ba'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.156413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1030/2033] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:33 2022] DELETE /identity/v3/users/f7ce3040c9bd430fb869b17e326cc6ba => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:34.160616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.161619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.162069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.183732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.185021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.262492 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:34.345657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1004/2034] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:34.357780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.360190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.484693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c4215-4bdb-438f-a14c-ebb5eb671804 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.497318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.499870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.501203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.501994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.529256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.534108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c9908-c75d-42de-bb58-1469df962827 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.560769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1031/2035] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:34.691805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:34.695438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:34.747337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334d7d-0a3f-4fa6-9b8f-7260028b1029 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:34.762341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:34.764289 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.765824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.766521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] PATH_INFO: `/v3/users/9fbef845b48f452bbb2ab129d33cce6c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.769055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbef845b48f452bbb2ab129d33cce6c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:34.772465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:34.882099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbef845b48f452bbb2ab129d33cce6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.883219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbef845b48f452bbb2ab129d33cce6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.915223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbef845b48f452bbb2ab129d33cce6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.935477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbef845b48f452bbb2ab129d33cce6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.955099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbef845b48f452bbb2ab129d33cce6c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:34.970608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1005/2036] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:34 2022] DELETE /identity/v3/users/9fbef845b48f452bbb2ab129d33cce6c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:34.972150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:34.972472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:34.972757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:34.994592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:34.996033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.120928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1032/2037] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:35.139612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.141525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.199781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.202203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.336314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42083d38-aceb-487c-b3e3-95f106c94b27 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.350148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.351479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.352134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.353203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.367156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.370848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.373534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1839966-ed2e-4443-bdae-1a99705aa73b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.379287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a273e47-9bb5-4403-b522-72b27096f88c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.397691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.399920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.401130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.401925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] PATH_INFO: `/v3/projects/393327d51d804763adb850d5aa42d654` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.403061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1006/2038] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:35.405959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393327d51d804763adb850d5aa42d654)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.411061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.437205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:35.530326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393327d51d804763adb850d5aa42d654', 'request_id': 'req-baf2f877-7a67-4a4a-8dae-7990bf68c806'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.552019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393327d51d804763adb850d5aa42d654', 'request_id': 'req-baf2f877-7a67-4a4a-8dae-7990bf68c806'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.569196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393327d51d804763adb850d5aa42d654', 'request_id': 'req-baf2f877-7a67-4a4a-8dae-7990bf68c806'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.581163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.581755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.582310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.586318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] The token cache is being invalidate because project 393327d51d804763adb850d5aa42d654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:35.587033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.587763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.592515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1033/2039] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:35 2022] DELETE /identity/v3/projects/393327d51d804763adb850d5aa42d654 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:35.598056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.600027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.619706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] MFA Rules not processed for user `c6a10467d2454c1aa14b71aebdb1a329`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:35.621952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.730708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1007/2040] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:35.736244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2f877-7a67-4a4a-8dae-7990bf68c806 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.762695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:35.766481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:35.775088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.776574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.779100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.780601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] PATH_INFO: `/v3/users/868225575fb04ebab29c633dbf859e98` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.784191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=868225575fb04ebab29c633dbf859e98)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:35.788976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:35.947572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868225575fb04ebab29c633dbf859e98'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:35.965040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3e4e8-7933-4413-afa8-6cbac771913f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:35.989820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:35.990992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:35.991448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:35.991955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:35.996398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868225575fb04ebab29c633dbf859e98'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.007588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.020910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868225575fb04ebab29c633dbf859e98'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.022364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868225575fb04ebab29c633dbf859e98'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.025650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868225575fb04ebab29c633dbf859e98'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.100987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1034/2041] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:35 2022] DELETE /identity/v3/users/868225575fb04ebab29c633dbf859e98 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:36.146839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.151598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198fe11-db62-452d-b067-39e87392985b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.167284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1008/2042] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:36.347733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.349487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.401215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.538599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc73064-a4c2-43ed-8fa0-3c3655f41c74 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.562749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.566009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.566582 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.569773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] PATH_INFO: `/v3/projects/9dbb264d89d44796b45ae01d009b55f5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.573699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbb264d89d44796b45ae01d009b55f5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.584730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.686701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbb264d89d44796b45ae01d009b55f5', 'request_id': 'req-2b892a4c-6e33-4045-9ca6-f27f8df446c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.699822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbb264d89d44796b45ae01d009b55f5', 'request_id': 'req-2b892a4c-6e33-4045-9ca6-f27f8df446c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.710830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbb264d89d44796b45ae01d009b55f5', 'request_id': 'req-2b892a4c-6e33-4045-9ca6-f27f8df446c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.724494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] The token cache is being invalidate because project 9dbb264d89d44796b45ae01d009b55f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:36.724896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.725472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2b892a4c-6e33-4045-9ca6-f27f8df446c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:36.727793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1035/2043] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:36 2022] DELETE /identity/v3/projects/9dbb264d89d44796b45ae01d009b55f5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:36.732813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.733374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.733374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.761905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:36.764175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.816240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:36.866845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1009/2044] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:36.876994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.877376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.877727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.883413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.886796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.908471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ee0da-0491-4c48-a11b-77428ee2ba5a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.909294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:36.910539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:36.915051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.916040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.916350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.916662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] PATH_INFO: `/v3/projects/cda46a0bf9424fe5984e35c383ae682e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.917947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda46a0bf9424fe5984e35c383ae682e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.920185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.920462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1036/2045] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:36.926740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.939568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865272-5a7c-452e-9de6-e72fc6b24c94 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.947200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:36.948564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:36.948836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:36.949270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:36.949901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:36.950251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:36.951921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:36.970616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1037/2046] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:42:36.972411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:36.984599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d46e9-1dfd-4970-a714-fe65af203eb5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:36.992735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda46a0bf9424fe5984e35c383ae682e', 'request_id': 'req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:37.001612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda46a0bf9424fe5984e35c383ae682e', 'request_id': 'req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:37.010573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda46a0bf9424fe5984e35c383ae682e', 'request_id': 'req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:37.023395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] The token cache is being invalidate because project cda46a0bf9424fe5984e35c383ae682e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:37.023829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:37.024745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7a71eea2-71e4-4f17-8bc9-198be13cf6f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:37.026759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1010/2047] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:36 2022] DELETE /identity/v3/projects/cda46a0bf9424fe5984e35c383ae682e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:37.032849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37c55-4357-4b90-8c57-886220ec8c9c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.033291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37c55-4357-4b90-8c57-886220ec8c9c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.033648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac37c55-4357-4b90-8c57-886220ec8c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.054564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dac37c55-4357-4b90-8c57-886220ec8c9c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.056397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dac37c55-4357-4b90-8c57-886220ec8c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.062588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.063267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.063553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.063933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.064578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.066575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.104444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1038/2048] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:36 2022] POST /identity/v3/projects => generated 360 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:37.104772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.106915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.127883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.135576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1011/2049] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:37.144084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.144459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.144711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.167588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.168881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.223312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf7b87-61a8-4513-863d-2d695b48fa04 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.235449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.236636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.236971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.237374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.238217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.240320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.249165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.270441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1012/2050] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:37.271865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.280555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1039/2051] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/users => generated 281 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:37.286149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.288357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f899315-6273-4bc1-a46c-9163bfe3c9c9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.295652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.303832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c4211-5755-4e78-bb12-31195f3ea101 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.304426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.304718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.305009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.305768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:37.306082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.307770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.313049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.313960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.314316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.318221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.319230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.322246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.324341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1013/2052] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:37.329145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.341814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a0555-a848-4c97-ac0d-916c8643822f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.347712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.349219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.349831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1040/2053] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:37.350113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.350401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.351328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.353400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.355683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.374028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5a0c-875e-4fd3-aa52-034f3d5e807f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.383589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.385574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.385965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.386347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.387421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.390285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.402930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1041/2054] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:37.406938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1014/2055] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/projects => generated 368 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:37.408894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.410937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.430118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d9c05-bc04-4a0c-a8ec-d30f02b3f396 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.525986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4002a7-ef4f-4011-a2b5-29d329b3e3c1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.534173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.535389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.537436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.538335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.539892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.544597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.545561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.545853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.546145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] PATH_INFO: `/v3/projects/532772d0a09a4e1c91eae59524aa7e2d/users/d42628631a044d4696607cd55c62f360/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.550881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.565584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=532772d0a09a4e1c91eae59524aa7e2d, user_id=d42628631a044d4696607cd55c62f360, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.570044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2d75f-84c4-4b3f-bb7b-ff261a9a8466 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.590844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1015/2056] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:37.595812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.602853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1042/2057] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:37 2022] PUT /identity/v3/projects/532772d0a09a4e1c91eae59524aa7e2d/users/d42628631a044d4696607cd55c62f360/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:37.603768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.604771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.605100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.608905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe11944-ef2c-4671-b4fe-2e51f8a40679 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.648157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] MFA Rules not processed for user `d42628631a044d4696607cd55c62f360`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:37.649511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.736322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.737174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.737568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.737925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.738751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.740780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.757596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1016/2058] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles => generated 1427 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:37.757596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.757596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.764265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:37.783649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1043/2059] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:37.784663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.817172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470c94e-3e37-49cf-bc28-746403c10522 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.841194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.841895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.842186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.842472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.843234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:37.844931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:37.870414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1044/2060] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:37.871587 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:37.874294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.920636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54379f-7a72-4600-b81f-738aa5bf28bb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:37.924190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:37.925389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:37.926414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:37.926538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:37.932696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:37.946917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.014215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c37abc-a8c1-4d98-bcc0-b8fc4bdbc8f8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.021493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.022743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.023129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.024415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.041983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.045160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.066531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1045/2061] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:38.082264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.095828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.098235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.105799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722be9b-6c23-4413-a034-b2f623605f3d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.111631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.112775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.113129 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.113466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] PATH_INFO: `/v3/projects/569ab6150d7449aa945d54cf1119b8a8/users/321e3c3146384648bdfcf5610806578f/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.119622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1017/2062] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:38.121361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.134019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569ab6150d7449aa945d54cf1119b8a8, user_id=321e3c3146384648bdfcf5610806578f, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.137483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50cd73-7cfb-4a6f-8ed0-b5f008cb4b60 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.141343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b64b1c-5482-4046-b997-1d5eb9063a2a service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.157306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.160536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.161547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.162262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] PATH_INFO: `/v3/users/d42628631a044d4696607cd55c62f360` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.164333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42628631a044d4696607cd55c62f360)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.167969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.170336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1046/2063] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:38 2022] PUT /identity/v3/projects/569ab6150d7449aa945d54cf1119b8a8/users/321e3c3146384648bdfcf5610806578f/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:38.190837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.191369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.191863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.248235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] MFA Rules not processed for user `321e3c3146384648bdfcf5610806578f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:38.249781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.284515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42628631a044d4696607cd55c62f360'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:38.285336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42628631a044d4696607cd55c62f360'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:38.319846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42628631a044d4696607cd55c62f360'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:38.332700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42628631a044d4696607cd55c62f360'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:38.356514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-94c86e02-b0fd-4b1f-bfd0-f07a3c1d5c53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42628631a044d4696607cd55c62f360'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:38.365897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1018/2064] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:38 2022] DELETE /identity/v3/users/d42628631a044d4696607cd55c62f360 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:38.371575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.372037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.372332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.380671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1047/2065] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:38.388683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.410962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:38.412237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.484361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.501612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe9f48-2b8a-4124-8a5f-07c712f101d3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.530169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1019/2066] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:38.538862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.540751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.560431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:38.590412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.591978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.591978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.591978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.592455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.594426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.628392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1048/2067] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/projects => generated 366 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:38.628616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85785b-2c04-4ce5-a4cd-bf283ce4aaf7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.629576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.631908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:38.701118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.702094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.702662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.703917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.736805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83b7f4-2ca5-4592-b022-fc01ead4a55a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.751065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.752830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.754150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.754820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.755735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.759862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.805590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1049/2068] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:38 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:38.807550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.826281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace32a70-1acb-4f0b-a961-44c9016bde12 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.833593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.834364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.834736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.835199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.835936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.839007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.845143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.848176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.858860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1050/2069] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:38.860201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.871953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aac537-98e7-46d3-bc4e-21c99690afe6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:38.878107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:38.879968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:38.880404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:38.880985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] PATH_INFO: `/v3/projects/5b3517d7ab804190aced606165916bdc/users/05d8a30973444d959e860a81b5dfea94/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:38.898202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1020/2070] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:38.909481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3517d7ab804190aced606165916bdc, user_id=05d8a30973444d959e860a81b5dfea94, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:38.914648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:38.945253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1051/2071] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:38 2022] PUT /identity/v3/projects/5b3517d7ab804190aced606165916bdc/users/05d8a30973444d959e860a81b5dfea94/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:38.950728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:38.981098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b2adc-4318-483e-a8ce-11d9740d7005 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.092327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.093223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.093553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.093991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.094837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.096747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18c567-a29c-4dd0-8b54-11d75d6d72c8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.110635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1021/2072] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:38 2022] GET /identity/v3/roles => generated 1427 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:39.116032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.128085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797484f1-baf8-48b9-a12a-dd4072f94dbb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.134753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.136068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.136625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.137013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] PATH_INFO: `/v3/projects/5b3517d7ab804190aced606165916bdc/users/05d8a30973444d959e860a81b5dfea94/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.140742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3517d7ab804190aced606165916bdc, user_id=05d8a30973444d959e860a81b5dfea94, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.144020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.159133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1052/2073] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:39 2022] PUT /identity/v3/projects/5b3517d7ab804190aced606165916bdc/users/05d8a30973444d959e860a81b5dfea94/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:39.176558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.176941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.177247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.226895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] MFA Rules not processed for user `05d8a30973444d959e860a81b5dfea94`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:39.229449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.237313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.341447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.345254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.413526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1022/2074] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:39.422597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.424102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.433331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:39.562017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc1250-3d11-4813-81d1-1143a235d75b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.570870 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.571285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da550e-e436-4493-aef7-95df81c35599 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:39.572171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.572736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.573293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] PATH_INFO: `/v3/projects/532772d0a09a4e1c91eae59524aa7e2d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.575403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=532772d0a09a4e1c91eae59524aa7e2d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.577116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:39.578756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.578756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.579125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.579440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.601262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:39.605184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7411f33-4061-4dcd-acfe-4301a5b27fbf service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:39.628620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1023/2075] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:39.689354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '532772d0a09a4e1c91eae59524aa7e2d', 'request_id': 'req-77266ae2-a7cb-484f-a9e0-b989de860e65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.706858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '532772d0a09a4e1c91eae59524aa7e2d', 'request_id': 'req-77266ae2-a7cb-484f-a9e0-b989de860e65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.718438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '532772d0a09a4e1c91eae59524aa7e2d', 'request_id': 'req-77266ae2-a7cb-484f-a9e0-b989de860e65'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.733038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] The token cache is being invalidate because project 532772d0a09a4e1c91eae59524aa7e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:39.733312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.735537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:39.737661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1053/2076] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:39 2022] DELETE /identity/v3/projects/532772d0a09a4e1c91eae59524aa7e2d => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:39.743075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23290d-c691-4f7c-9244-a92fae6a439c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.743386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23290d-c691-4f7c-9244-a92fae6a439c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.743661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23290d-c691-4f7c-9244-a92fae6a439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.776327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-eb23290d-c691-4f7c-9244-a92fae6a439c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:39.777766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eb23290d-c691-4f7c-9244-a92fae6a439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.909908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:39.915950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:39.939972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1024/2077] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:39.955162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:39.955742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:39.956284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:39.999784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:40.002484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.027944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1025/2078] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:40.041954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.083569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139dd0a-f51b-43ba-8ff2-bce98530c370 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.095450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.096503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.096987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.097646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.098983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:40.099304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.102694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.135066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1026/2079] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:40.140754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77266ae2-a7cb-484f-a9e0-b989de860e65 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.142309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.145564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.146754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.147249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.147883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.150849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.219559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da1398-ff85-4745-8404-6530844c4b1f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.227003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.228497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.229186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.229817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.230822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.233485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.239471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.275394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1027/2080] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:40 2022] POST /identity/v3/projects => generated 386 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:40.279680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.333668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.335324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.350380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1054/2081] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:40.421389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563a84d-b225-48ce-86d5-21b889779ef8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.429302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.431026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.431373 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.431906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.433045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.435837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.466764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1028/2082] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:40 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:40.470992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.484751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d66ca-1bfc-4946-bae6-0232cd9866a2 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.491279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.491971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.492256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.493643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.493869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.495542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.498611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:40.513979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.518215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1055/2083] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:40.527982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17216cbe-2be5-421f-b23e-cb2c40a154bd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.535104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.536112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.537711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.537711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.539382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.542401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea1033-b767-4c93-9346-5e7da8a1d142 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.556923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1029/2084] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/roles => generated 1427 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:40.561963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:40.574580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bd210-85cd-4ee7-a496-53d3cdad9b25 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:40.582867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:40.583738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.584085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.584669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] PATH_INFO: `/v3/projects/55a284af58b44a8e868b810e4c86abb8/users/a9fae4e59ae7477b9a6124aba46bac8b/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.614522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=55a284af58b44a8e868b810e4c86abb8, user_id=a9fae4e59ae7477b9a6124aba46bac8b, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:40.617595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:40.640292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1056/2085] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:40 2022] PUT /identity/v3/projects/55a284af58b44a8e868b810e4c86abb8/users/a9fae4e59ae7477b9a6124aba46bac8b/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:40.654772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:40.655309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:40.655828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:40.742106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] MFA Rules not processed for user `a9fae4e59ae7477b9a6124aba46bac8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:40.744426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:40.927433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1030/2086] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:40.945654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:41.075092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db74b3c-f2eb-4e7f-a420-ee98bbb146ce admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:41.080799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:41.081484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:41.081763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:41.082069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:41.097632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:41.098843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652ed1e-ee5a-41b5-a190-7f2adf9ac2ed service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:41.111807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1057/2087] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:43.917675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.068406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:44.089883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fd95e-af26-4623-a316-13790cacc918 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.103442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.104594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.105003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.105396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] PATH_INFO: `/v3/users/a9fae4e59ae7477b9a6124aba46bac8b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.107041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9fae4e59ae7477b9a6124aba46bac8b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.109238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.270928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9fae4e59ae7477b9a6124aba46bac8b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:44.277420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9fae4e59ae7477b9a6124aba46bac8b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:44.333915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9fae4e59ae7477b9a6124aba46bac8b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:44.346995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9fae4e59ae7477b9a6124aba46bac8b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:44.365945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9fae4e59ae7477b9a6124aba46bac8b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:44.376508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1031/2088] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:43 2022] DELETE /identity/v3/users/a9fae4e59ae7477b9a6124aba46bac8b => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:44.378911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce53a-41ca-4f0d-91ef-25c124b83675 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.379528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce53a-41ca-4f0d-91ef-25c124b83675 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.379528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ce53a-41ca-4f0d-91ef-25c124b83675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.411698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ff1ce53a-41ca-4f0d-91ef-25c124b83675 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:44.413785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ff1ce53a-41ca-4f0d-91ef-25c124b83675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:44.511119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1058/2089] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:44.527014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.528991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:44.688563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df6db9-ee24-4abc-8a2e-7e5924d80009 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:44.699932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:44.702845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.703126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.703478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.728817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:44.728817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe39c1-7045-414f-be93-c9bb0505f01d service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:44.751820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1032/2090] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:44.797319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.797646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.797938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.800403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1059/2091] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:42:44 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:42:44.819839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:44.821755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:44.822248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:44.856560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] MFA Rules not processed for user `5b1115a902664ed991ab40344b36cd60`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:44.859262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:44.965910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:44.968823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.002266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0bbc3-384c-4a02-894e-97af62ff92be None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.012730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.014411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.015041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.015696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] PATH_INFO: `/v3/users/20b7990551ac458cb94c8bc922152650` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.017787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1033/2092] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:45.020159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b7990551ac458cb94c8bc922152650)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.024426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.043313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.045275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.061546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb142e-b9fe-4cee-8335-5ae528047b9f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.067806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.068825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.069116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.069403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.083367 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.085211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.093544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.103015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1034/2093] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:45.160939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b7990551ac458cb94c8bc922152650'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.223976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b7990551ac458cb94c8bc922152650'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.226178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:45.242874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b7990551ac458cb94c8bc922152650'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.246261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b7990551ac458cb94c8bc922152650'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.247687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b7990551ac458cb94c8bc922152650'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.269600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1060/2094] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:44 2022] DELETE /identity/v3/users/20b7990551ac458cb94c8bc922152650 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:45.598269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.612653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ab5f6-3cc6-4222-83a2-707ac520b422 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.693163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.694174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.694558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.694902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] PATH_INFO: `/v3/projects/86b15e7956a347cba0b1dca0a45c8482` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.696190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:45.697175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b15e7956a347cba0b1dca0a45c8482)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.699144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.699268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.732906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee7b573-18d4-4692-8f6a-0e7aa2bbaedb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:45.746590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:45.747482 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.748004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.748211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] PATH_INFO: `/v3/projects/55a284af58b44a8e868b810e4c86abb8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.749735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55a284af58b44a8e868b810e4c86abb8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:45.752006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:45.790736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b15e7956a347cba0b1dca0a45c8482', 'request_id': 'req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.808477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b15e7956a347cba0b1dca0a45c8482', 'request_id': 'req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.833675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b15e7956a347cba0b1dca0a45c8482', 'request_id': 'req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.845491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55a284af58b44a8e868b810e4c86abb8', 'request_id': 'req-11061d1f-158b-4b8d-addb-2392c9ebf50e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.859123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55a284af58b44a8e868b810e4c86abb8', 'request_id': 'req-11061d1f-158b-4b8d-addb-2392c9ebf50e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.865407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] The token cache is being invalidate because project 86b15e7956a347cba0b1dca0a45c8482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:45.865882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.867571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e9b5922-73b8-4fc6-8abc-22e2c9941eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.871445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1035/2095] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:45 2022] DELETE /identity/v3/projects/86b15e7956a347cba0b1dca0a45c8482 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:45.879019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55a284af58b44a8e868b810e4c86abb8', 'request_id': 'req-11061d1f-158b-4b8d-addb-2392c9ebf50e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.883946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0abeb-5de7-432a-a6e4-3107eef91626 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.884496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0abeb-5de7-432a-a6e4-3107eef91626 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.884932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0abeb-5de7-432a-a6e4-3107eef91626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.899011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] The token cache is being invalidate because project 55a284af58b44a8e868b810e4c86abb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:45.900244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.902559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-11061d1f-158b-4b8d-addb-2392c9ebf50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:45.906393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1061/2096] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:45 2022] DELETE /identity/v3/projects/55a284af58b44a8e868b810e4c86abb8 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:45.911563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8f4-8a9e-464e-8754-5cdd81170a87 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:45.913115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8f4-8a9e-464e-8754-5cdd81170a87 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:45.913659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38d8f4-8a9e-464e-8754-5cdd81170a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:45.990743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6e38d8f4-8a9e-464e-8754-5cdd81170a87 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.992902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6e38d8f4-8a9e-464e-8754-5cdd81170a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:45.996129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-37e0abeb-5de7-432a-a6e4-3107eef91626 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:45.998797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37e0abeb-5de7-432a-a6e4-3107eef91626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.123985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1036/2097] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.134339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.134877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.135303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.147299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1062/2098] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.149931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.150230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.151092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.166416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.168816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.176311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.179312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.181113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1037/2099] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.185703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.200163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1063/2100] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.202486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.206580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba8e1-5a38-48a9-a9dd-0486ec40934e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.214074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.214621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.214842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.215813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.217039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:46.217370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.222695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.226736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.237562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae584e-c593-468a-9b3f-19d8cfb6b459 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.247499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.249017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.249581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.250050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.251328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:46.252144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.255650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.262857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1038/2101] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:46.264398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.283809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1064/2102] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:46.289231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.296344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724d7-bfe0-4e18-86ac-413ac9bfaf31 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.315553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a0c7d-ba06-4a74-afd1-eab37b0fd92b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.323805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.324628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.326026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.326026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.326468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.327615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.328401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.329185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.329515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.330155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.331857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.336324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.378941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1039/2103] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/projects => generated 378 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:46.384610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1065/2104] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/projects => generated 374 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:46.386511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.390319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.431384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.511805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b08bc-5541-429d-afce-29c6a273e4d0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.514482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bbcfb-f507-4ef9-b352-74495c6e2880 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.521872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.523185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.523388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.524099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.524323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.524856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.525361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.525521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.526544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.526919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.530258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.530756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.570176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1040/2105] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:46.570471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1066/2106] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:46.571024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.571911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.589472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39380239-d0ab-46fb-b831-c12db17f9e12 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.589968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4adcbc7-99e3-4444-b0bd-33e9e3ef18eb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.598352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.598939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.599601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.600136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.600547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.600707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.601017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.601667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.602050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.603530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.604988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.606389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.625355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1067/2107] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:46.625569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1041/2108] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:46.627085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.628431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.640810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a548704-0107-4cbd-bf5b-7a4d106df902 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.643732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ae615-6d91-4e84-8ce8-dab96dabe564 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.646465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.647243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.647536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.647827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.648606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.650305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.651612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.652801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.653492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.653979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.655469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.658106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.666111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1042/2109] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:46.677659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1068/2110] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:46.677955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.679049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.691117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d0c08-46bf-48d4-9a9e-9c2af1333a61 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.695297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ce900-bb83-42ad-b5b3-e145ffccfa15 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.698082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.699041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.699333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.699614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] PATH_INFO: `/v3/projects/671df32b5f2741a489950b927f54c0ce/users/10da7a2d618c4a71bf10e85b69881942/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.707648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.709493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.710029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.710650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] PATH_INFO: `/v3/projects/396a2cae8abb4fa08c8f7a3b5fe7c4c6/users/c61ef21c8d934a4d9101c2c086ab8936/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.717433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671df32b5f2741a489950b927f54c0ce, user_id=10da7a2d618c4a71bf10e85b69881942, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.719761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c44cd-0a6c-4f7f-80ed-d70d306073a1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.737213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1069/2111] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:46 2022] PUT /identity/v3/projects/671df32b5f2741a489950b927f54c0ce/users/10da7a2d618c4a71bf10e85b69881942/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:46.743693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] RBAC: Authorizing `identity:create_grant(project_id=396a2cae8abb4fa08c8f7a3b5fe7c4c6, user_id=c61ef21c8d934a4d9101c2c086ab8936, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.747350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fb55a-8113-4aab-b0bb-0230a1bd215c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.759461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.759760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.760038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.768922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1043/2112] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:46 2022] PUT /identity/v3/projects/396a2cae8abb4fa08c8f7a3b5fe7c4c6/users/c61ef21c8d934a4d9101c2c086ab8936/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:46.780859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.782392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.783093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.800699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] MFA Rules not processed for user `10da7a2d618c4a71bf10e85b69881942`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.804333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.833315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] MFA Rules not processed for user `c61ef21c8d934a4d9101c2c086ab8936`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:46.835531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.889968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1070/2113] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:46.897873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.954469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1044/2114] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:46.955977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:46.967709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:46.971099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:46.973187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153d447-1521-42da-9a97-b9bf96ce8acd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:46.978380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:46.979060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:46.979348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:46.979628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:46.980335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:46.982427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:46.988590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.019231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1071/2115] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:46 2022] POST /identity/v3/projects => generated 376 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:47.023046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.053725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52dc675-a61d-44a8-8e2c-f90ecd4de565 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.144218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa15c99-67dd-4b76-a867-438db4237653 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.152779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.154562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.154717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.155198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.159732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.161089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.161651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.162619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.165497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.169691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.234664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1072/2116] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:47 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:47.236212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.254897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3803e4-f44d-47bf-a6e7-3732f4465b1e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.257349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.259333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.265993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.268098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.268691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.269780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.271046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1045/2117] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:47.271254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.276905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.297756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1073/2118] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/roles => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:47.305035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.343849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327b849-eff4-42df-a09b-cabdb4df3fe1 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.351711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.353594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.353594 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.354149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] PATH_INFO: `/v3/projects/9068235c46124dfaa1c638dd320aed07/users/13a5354e8f9540c7afba45650bbcaa89/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.385400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9068235c46124dfaa1c638dd320aed07, user_id=13a5354e8f9540c7afba45650bbcaa89, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.388248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.421313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.421811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1046/2119] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:47 2022] PUT /identity/v3/projects/9068235c46124dfaa1c638dd320aed07/users/13a5354e8f9540c7afba45650bbcaa89/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:47.432764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbd680-b2ca-4de7-8533-aff1057f3662 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.522664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.523597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.524026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.524026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.526035 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.528017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cc166-869f-4f81-8a64-5080f060dd9d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.540341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1074/2120] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/roles => generated 1427 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:47.544744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.574612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75d32f-e54c-4bda-aa95-c3480e26c9aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.582321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.583580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.583998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.584419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] PATH_INFO: `/v3/projects/9068235c46124dfaa1c638dd320aed07/users/13a5354e8f9540c7afba45650bbcaa89/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.588480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9068235c46124dfaa1c638dd320aed07, user_id=13a5354e8f9540c7afba45650bbcaa89, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.592279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:47.608158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1047/2121] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:47 2022] PUT /identity/v3/projects/9068235c46124dfaa1c638dd320aed07/users/13a5354e8f9540c7afba45650bbcaa89/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:47.620009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.620501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.621017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.691442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] MFA Rules not processed for user `13a5354e8f9540c7afba45650bbcaa89`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:47.693904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.755278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.759487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:47.789002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.837988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:47.845580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1075/2122] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:47.877431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:47.888913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397b967-d855-4ee7-a88d-f802b45136e3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:47.897199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:47.898732 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:47.899257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:47.899995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] PATH_INFO: `/v3/users/321e3c3146384648bdfcf5610806578f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:47.902931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321e3c3146384648bdfcf5610806578f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:47.907269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.043126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5510-caa3-4bd0-a6ff-e52490040851 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.048467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321e3c3146384648bdfcf5610806578f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:48.049835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321e3c3146384648bdfcf5610806578f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:48.056751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.060751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.061622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.062303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.091222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321e3c3146384648bdfcf5610806578f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:48.107547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321e3c3146384648bdfcf5610806578f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:48.126282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0aa2f4a4-b8af-4a99-aea7-572fe715c4c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321e3c3146384648bdfcf5610806578f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:48.141184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1048/2123] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:47 2022] DELETE /identity/v3/users/321e3c3146384648bdfcf5610806578f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:48.149827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.152196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.153767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.201976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:48.204482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:48.231487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.233025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.244621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1076/2124] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:48.341023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1049/2125] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:48.357711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:48.359350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:48.453995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e03c-fa83-4d0a-9237-87185392c17a service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:48.535497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:48.546874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:48.547972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:48.548671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:48.549101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:48.566995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:48.570137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:48.589239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1077/2126] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:49.222504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.224713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:49.239633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d2e4c-86ea-4a45-9d8c-42fed56097a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.244552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.245512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.245873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.246223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] PATH_INFO: `/v3/projects/569ab6150d7449aa945d54cf1119b8a8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.247545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569ab6150d7449aa945d54cf1119b8a8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.249643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.303351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569ab6150d7449aa945d54cf1119b8a8', 'request_id': 'req-f79968f0-cbf7-4e86-8681-69a6bff69167'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.307529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:49.310510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569ab6150d7449aa945d54cf1119b8a8', 'request_id': 'req-f79968f0-cbf7-4e86-8681-69a6bff69167'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.325525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569ab6150d7449aa945d54cf1119b8a8', 'request_id': 'req-f79968f0-cbf7-4e86-8681-69a6bff69167'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.338949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] The token cache is being invalidate because project 569ab6150d7449aa945d54cf1119b8a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:49.339238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.339942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.341574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1050/2127] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:49 2022] DELETE /identity/v3/projects/569ab6150d7449aa945d54cf1119b8a8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:49.345801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:49.355663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4f93d3-af24-4872-857e-aef34d3b411f service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:49.418175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:49.419061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:49.419346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:49.419627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] PATH_INFO: `/v3/users/05d8a30973444d959e860a81b5dfea94` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:49.420902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d8a30973444d959e860a81b5dfea94)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:49.422883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:49.481050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d8a30973444d959e860a81b5dfea94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.498608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d8a30973444d959e860a81b5dfea94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.521660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d8a30973444d959e860a81b5dfea94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.522268 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d8a30973444d959e860a81b5dfea94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.523206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1bec537f-e36b-4e20-b849-b645b8a0dd43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d8a30973444d959e860a81b5dfea94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:49.554506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1078/2128] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:49 2022] DELETE /identity/v3/users/05d8a30973444d959e860a81b5dfea94 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.069586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.072275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.131142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79968f0-cbf7-4e86-8681-69a6bff69167 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.261328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.262874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.263393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.263902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] PATH_INFO: `/v3/projects/5b3517d7ab804190aced606165916bdc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.266493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3517d7ab804190aced606165916bdc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.270182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.359094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3517d7ab804190aced606165916bdc', 'request_id': 'req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.365556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3517d7ab804190aced606165916bdc', 'request_id': 'req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.374675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3517d7ab804190aced606165916bdc', 'request_id': 'req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.389109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] The token cache is being invalidate because project 5b3517d7ab804190aced606165916bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:50.389412 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.390187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-505c8cc1-d0bc-49c3-9b4e-1ed60ab0274f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:50.391931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1051/2129] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:50 2022] DELETE /identity/v3/projects/5b3517d7ab804190aced606165916bdc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:50.398249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.399615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.399792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.433513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:50.435548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.543951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1079/2130] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:50.553633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db2e0-9679-422f-be20-99462e780b1e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.554081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db2e0-9679-422f-be20-99462e780b1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.554495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468db2e0-9679-422f-be20-99462e780b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.591658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-468db2e0-9679-422f-be20-99462e780b1e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:50.593093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-468db2e0-9679-422f-be20-99462e780b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:50.608895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1052/2131] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:50.614882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.632143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7c926-9a12-4ca5-b481-3b762918ca65 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.644668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.644668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.644668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.644668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.645218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:50.645218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.646377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.650128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:50.662918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1080/2132] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:50.667624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468db2e0-9679-422f-be20-99462e780b1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.678119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468db2e0-9679-422f-be20-99462e780b1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.684992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.685696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.685988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.686267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.686993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.689043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.732947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1053/2133] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/projects => generated 386 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:50.737193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.750278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1918209-1f27-48e7-b807-8b7836934697 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.824070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.824790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.825073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.825348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.826057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.828005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.854856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1081/2134] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:50 2022] POST /identity/v3/users => generated 294 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:50.860641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.873881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c54091-34e7-40d6-8454-6a727e4a58d5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.880783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.882212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.882983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.884284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.886094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.890520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.910637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1054/2135] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:50.914778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.926122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03892166-f9a4-49a4-8df8-fbf64660282d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.931759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.932653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.933041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.933382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:50.934250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:50.935960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a458f35-9ee0-4ed7-8c2b-52d4f9e0231f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:50.950205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1082/2136] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:50 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:50.954590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:50.969070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a2655-ad0a-4f48-99ff-e45223582387 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:50.977163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:50.978200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:50.978794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:50.979192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] PATH_INFO: `/v3/projects/d058d54a4dfd4502a3d038730a93e315/users/02ad9195f9e74333ad048aafd961ad0b/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.009214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d058d54a4dfd4502a3d038730a93e315, user_id=02ad9195f9e74333ad048aafd961ad0b, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.017396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.036134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1055/2137] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:50 2022] PUT /identity/v3/projects/d058d54a4dfd4502a3d038730a93e315/users/02ad9195f9e74333ad048aafd961ad0b/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:51.047776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.048076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.048346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.098344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] MFA Rules not processed for user `02ad9195f9e74333ad048aafd961ad0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.100595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.205740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1083/2138] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:51.217989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.219736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.231819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.284577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f5265-29a6-483f-a532-83d0f8abb1fb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.288799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.290312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.290612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.290898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.300697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.302173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744541c8-d50b-4ff6-a552-e8e17dd5023e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.314128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1056/2139] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:51.334239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.436282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d20ee-3cfc-47ac-966a-5869151aca47 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.441733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.442787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.443336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.443632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] PATH_INFO: `/v3/users/02ad9195f9e74333ad048aafd961ad0b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.444946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ad9195f9e74333ad048aafd961ad0b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.447429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.453676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:51.509102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ad9195f9e74333ad048aafd961ad0b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.523780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ad9195f9e74333ad048aafd961ad0b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.533087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ad9195f9e74333ad048aafd961ad0b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.533722 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ad9195f9e74333ad048aafd961ad0b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.534406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ad9195f9e74333ad048aafd961ad0b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:51.548784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1084/2140] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:42:51 2022] DELETE /identity/v3/users/02ad9195f9e74333ad048aafd961ad0b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:51.554669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.554928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.555246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.584675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:51.587780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.701068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1057/2141] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:51.714178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:51.716939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:51.813496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68426d73-aace-49f2-92b3-534cc30f26a1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:51.821903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:51.823026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:51.823547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:51.824643 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:51.843276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:51.846187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f68dd6e-8ca9-49be-b390-2da7112ac3c4 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:51.865235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1085/2142] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:42:52.292068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.293759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.308919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8025cb-7e21-4cdc-a569-b6625a039abf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.314865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.316701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.317313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.317752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] PATH_INFO: `/v3/projects/d058d54a4dfd4502a3d038730a93e315` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.320179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d058d54a4dfd4502a3d038730a93e315)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.323463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.390957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd058d54a4dfd4502a3d038730a93e315', 'request_id': 'req-9389f921-0f1e-49c2-8fae-128bb08be0c0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:52.400748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd058d54a4dfd4502a3d038730a93e315', 'request_id': 'req-9389f921-0f1e-49c2-8fae-128bb08be0c0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:52.413658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd058d54a4dfd4502a3d038730a93e315', 'request_id': 'req-9389f921-0f1e-49c2-8fae-128bb08be0c0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:52.428753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] The token cache is being invalidate because project d058d54a4dfd4502a3d038730a93e315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:42:52.429041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:52.429763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9389f921-0f1e-49c2-8fae-128bb08be0c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:42:52.431985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1058/2143] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:42:52 2022] DELETE /identity/v3/projects/d058d54a4dfd4502a3d038730a93e315 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:52.437474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.438537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.438537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.463178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.464819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.564701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1086/2144] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:52.571821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.572114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.572617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.606931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:52.608199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:52.623207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1059/2145] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:52.629828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.654569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9be5c-1d59-4f5e-a4f2-e420823e9b14 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.664965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.666502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.667141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.667854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.669852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:42:52.670885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.674460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.699183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1087/2146] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:42:52.703457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.714060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b3890-90b3-4033-851b-48a4207ee828 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.719467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.720526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.720526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.721382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.721839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.723851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.754676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1060/2147] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/projects => generated 378 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:52.759321 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.769743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be1a9e-0168-448f-a45c-44e3a88ab040 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.780502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.839163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.839917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.840212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.840529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.841254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.843217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.866458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1088/2148] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:52 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:52.873509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.887862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401956-4462-4074-8a42-618e716030c7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.895846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.896956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.897361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.897735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.898721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.901940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.906656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:52.918423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1061/2149] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/roles => generated 1427 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:52.924874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.937502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa31616-4d11-4eea-8094-43ecd7130dae admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.943490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.944340 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.944730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.945111 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:52.946094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:52.947929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe0627-26a6-4a99-922e-8bf0ca800b0c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:52.960428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1089/2150] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:52 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:42:52.965137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:52.977801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3e62-86af-4641-aca4-dd44129a80a0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:52.982953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:52.983960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:52.984255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:52.984641 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] PATH_INFO: `/v3/projects/49c1740233274b27818f44061d51dfcf/users/951050fed8f54d20bd84111e6cb1a899/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.004080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c1740233274b27818f44061d51dfcf, user_id=951050fed8f54d20bd84111e6cb1a899, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.008212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.025737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1062/2151] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:52 2022] PUT /identity/v3/projects/49c1740233274b27818f44061d51dfcf/users/951050fed8f54d20bd84111e6cb1a899/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:53.036464 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.037740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.038060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.070292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] MFA Rules not processed for user `951050fed8f54d20bd84111e6cb1a899`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:53.071757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:53.188328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1090/2152] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:42:53.193378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.303954 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fad42-4d91-402d-b625-59f20041754e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.317100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.317835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.318405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.318751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.319652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.322132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.356292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1063/2153] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/projects => generated 376 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:53.361497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.379618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb705dd2-2d2e-4b0a-9802-2de7760220a0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.496782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.497909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.498967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.498967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.499984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.503485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.539390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1091/2154] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:42:53.545759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.559377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681262b8-2a7c-4af4-a638-db1c0e55eebf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.565267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.566030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.566388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.566743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.567577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.569640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.582562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1064/2155] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:53 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:53.588668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.599578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e903-aab1-4fde-aa5b-f85f569df556 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.605113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.605816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.606103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.606381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.607135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.608878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b366aa5a-c5c7-42e3-a4fd-9690484b0154 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.615343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:53.622087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1092/2156] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:53 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:53.626988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.638275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bbac7-7d4c-4edd-9d65-3fd73430b3e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.643647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.644752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.645044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.645330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] PATH_INFO: `/v3/projects/4cc62654b6e74b4a9b09c16149f9f5d7/users/afdce6bde39449708eb58f56e62fa79d/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.677837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc62654b6e74b4a9b09c16149f9f5d7, user_id=afdce6bde39449708eb58f56e62fa79d, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.683542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.705475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1065/2157] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:53 2022] PUT /identity/v3/projects/4cc62654b6e74b4a9b09c16149f9f5d7/users/afdce6bde39449708eb58f56e62fa79d/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:53.718214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.718579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.718910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.750186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] MFA Rules not processed for user `afdce6bde39449708eb58f56e62fa79d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:53.751443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:53.826898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1093/2158] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:53.831777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.925684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc8f12-d6df-4b87-bf06-e3349dbfeab6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:53.932474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:53.933287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:53.933665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:53.934055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:53.934869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:53.937033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:53.967861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1066/2159] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/projects => generated 378 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:53.972592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:53.984345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e850cef-2d3d-494a-9f40-37f9cb178ae0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.050513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.051105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.051396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.051674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.052462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.054413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.079909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1094/2160] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:42:53 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:42:54.084011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.095963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e431400-609c-47b6-98ed-9974f5a885ff admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.101661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.102390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.102688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.102975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.103735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.105445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.107136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:54.122736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1067/2161] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:54.126244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.140551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d998b4-648b-43d2-ba8f-69812b9d1cff admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.148528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.150104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.150603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.151085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] PATH_INFO: `/v3/projects/79c6e276ef4a4809bebe537e4d8dd126/users/8df9e5f33fe349b0ae0d9066f032e2bb/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.179622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c6e276ef4a4809bebe537e4d8dd126, user_id=8df9e5f33fe349b0ae0d9066f032e2bb, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.185828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.216508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1095/2162] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:54 2022] PUT /identity/v3/projects/79c6e276ef4a4809bebe537e4d8dd126/users/8df9e5f33fe349b0ae0d9066f032e2bb/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:42:54.222037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.237727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bcdeb-91bd-4b2b-9520-f80d2e2ff5e1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.332995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.334019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.334411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.334819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.336045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.337960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce4850-f1e4-44f7-9f40-de4a854fd6ff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.354604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1068/2163] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/roles => generated 1427 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:42:54.360660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.378160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5381f-a31e-4dc6-b074-a11c2f3b34df admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.384182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.385673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.386173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.386651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] PATH_INFO: `/v3/projects/79c6e276ef4a4809bebe537e4d8dd126/users/8df9e5f33fe349b0ae0d9066f032e2bb/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.389459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c6e276ef4a4809bebe537e4d8dd126, user_id=8df9e5f33fe349b0ae0d9066f032e2bb, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.392528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.406190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1096/2164] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:42:54 2022] PUT /identity/v3/projects/79c6e276ef4a4809bebe537e4d8dd126/users/8df9e5f33fe349b0ae0d9066f032e2bb/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:42:54.418002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.418304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.418597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.449742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] MFA Rules not processed for user `8df9e5f33fe349b0ae0d9066f032e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:42:54.451844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.553939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1069/2165] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:42:54.593470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:54.595248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:54.650366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:42:54.666742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827e493-598e-4b0f-a321-5919dfaf1abd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:54.671833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:54.672759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:54.673133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:54.673496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:54.752333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:54.755071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:54.771282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1097/2166] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:42:57.606566 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:42:57.617109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4ac8e-e190-474f-b9a7-8198dde2e5c3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:42:57.621985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:42:57.622721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:42:57.622948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:42:57.623232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:42:57.625304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:42:57.703197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:42:57.705005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:42:57.719850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1070/2167] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:42:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:00.097350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:00.106562 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de907e-f541-4999-895f-45257dc733b0 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:00.111109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:00.111853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:00.112138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:00.112453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:00.226144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:00.229203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:00.246351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1098/2168] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:02.981423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:02.991012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854afe9-2e98-4ddc-b857-a9f691d6de81 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:02.995918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:02.996730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:02.997061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:02.997341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:03.008126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:03.010216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:03.014831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:03.023999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1071/2169] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:07.456902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.459399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:07.570384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1bc9-0b48-432b-8f59-2b3105931d7d service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:07.577286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:07.578336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:07.578677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:07.579024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] PATH_INFO: `/v3/users/755c93adb65f4f6b938f5c9c5ca9b2af` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:07.580494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] RBAC: Authorizing `identity:delete_user(user_id=755c93adb65f4f6b938f5c9c5ca9b2af)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:07.582605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:07.637956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:07.650994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '755c93adb65f4f6b938f5c9c5ca9b2af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.671691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '755c93adb65f4f6b938f5c9c5ca9b2af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.681320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '755c93adb65f4f6b938f5c9c5ca9b2af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.681994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '755c93adb65f4f6b938f5c9c5ca9b2af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.682734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '755c93adb65f4f6b938f5c9c5ca9b2af'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:07.697701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1099/2170] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:07 2022] DELETE /identity/v3/users/755c93adb65f4f6b938f5c9c5ca9b2af => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:07.942281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:07.960077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaca81-20e6-4875-b2e3-639f58a64cdd service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.054126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.056337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.057331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.057848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] PATH_INFO: `/v3/projects/f763553c9b12481c96cc99b71f24d841` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.060088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f763553c9b12481c96cc99b71f24d841)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.064223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.145917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f763553c9b12481c96cc99b71f24d841', 'request_id': 'req-2fde902d-a931-475b-8429-ae35517ac93d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.164217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f763553c9b12481c96cc99b71f24d841', 'request_id': 'req-2fde902d-a931-475b-8429-ae35517ac93d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.183250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f763553c9b12481c96cc99b71f24d841', 'request_id': 'req-2fde902d-a931-475b-8429-ae35517ac93d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.208569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] The token cache is being invalidate because project f763553c9b12481c96cc99b71f24d841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:08.208901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.209950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.212509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1072/2171] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:07 2022] DELETE /identity/v3/projects/f763553c9b12481c96cc99b71f24d841 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:08.217152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.218620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.237979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef94abb-6bfc-4381-b63d-b46bf21a501f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.320581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.321756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.322048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.322337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] PATH_INFO: `/v3/users/c6a10467d2454c1aa14b71aebdb1a329` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.323618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a10467d2454c1aa14b71aebdb1a329)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.325592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.376559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a10467d2454c1aa14b71aebdb1a329'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.390529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a10467d2454c1aa14b71aebdb1a329'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.399601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a10467d2454c1aa14b71aebdb1a329'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.400392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a10467d2454c1aa14b71aebdb1a329'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.401131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-733cb34e-4d16-4e19-befc-358da251b993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a10467d2454c1aa14b71aebdb1a329'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.415325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1100/2172] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:08 2022] DELETE /identity/v3/users/c6a10467d2454c1aa14b71aebdb1a329 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:08.628836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:08.631356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.654686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde902d-a931-475b-8429-ae35517ac93d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:08.748665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:08.749581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.749888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.750209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] PATH_INFO: `/v3/projects/d911c2ecaa8f474ab3b9cf735693f777` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.751745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d911c2ecaa8f474ab3b9cf735693f777)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:08.753775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:08.792580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.809268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd911c2ecaa8f474ab3b9cf735693f777', 'request_id': 'req-98e19067-8e0b-4406-98a6-4f3b29780307'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.816493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd911c2ecaa8f474ab3b9cf735693f777', 'request_id': 'req-98e19067-8e0b-4406-98a6-4f3b29780307'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.825674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd911c2ecaa8f474ab3b9cf735693f777', 'request_id': 'req-98e19067-8e0b-4406-98a6-4f3b29780307'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.842061 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] The token cache is being invalidate because project d911c2ecaa8f474ab3b9cf735693f777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:08.842375 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.843152 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-98e19067-8e0b-4406-98a6-4f3b29780307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:08.845520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1073/2173] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:08 2022] DELETE /identity/v3/projects/d911c2ecaa8f474ab3b9cf735693f777 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:08.850875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.851384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.851468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:08.901724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:08.902949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:08.925702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:08.978476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1101/2174] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:08.986643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:08.987194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:08.987194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.009401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:09.010770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:09.019189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1074/2175] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:09.024084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.038573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78aa09-0c9b-4be2-9d07-42b081f4f433 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.046326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.047509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.048024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.048573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.049952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:09.050514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.053735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.077984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1102/2176] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:09.082455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.093255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafa5bb-930c-4c2f-83d5-d7e67cf41173 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.098318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.098989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.099276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.099552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.100538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.102491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.136462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1075/2177] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:09 2022] POST /identity/v3/projects => generated 384 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:09.142893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.154244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf2e7-ae6a-4065-8426-b716160b832f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.237578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.238917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.239478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.239996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.241378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.244470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.267371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1103/2178] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:09 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:09.272503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.287967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b59ce-39f5-4f7d-930c-73d8ef24f805 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.293841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.294524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.294807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.295088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.296076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.297776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.312270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1076/2179] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:09.317612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.333551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df32f1d-cc33-4af8-9587-227c7db7840d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.339913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.341806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.342219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.342734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.343979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.347167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d9fae-e95a-4163-8441-4c8a057abb70 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.364005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1104/2180] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:09.369181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.380306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aebc-24b0-4363-81b4-ad2a735471a6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.385358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.386339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.386686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.387044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] PATH_INFO: `/v3/projects/1b926bddf2c1496cbd427194e724f673/users/e80e990d139a40a284aaddfc95891c16/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.411209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b926bddf2c1496cbd427194e724f673, user_id=e80e990d139a40a284aaddfc95891c16, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.413975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.431552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1077/2181] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:09 2022] PUT /identity/v3/projects/1b926bddf2c1496cbd427194e724f673/users/e80e990d139a40a284aaddfc95891c16/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:09.443963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.444279 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.444738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.475176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] MFA Rules not processed for user `e80e990d139a40a284aaddfc95891c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:09.476449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:09.562039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1105/2182] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:09.568386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.634247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035955d-3c2e-42c3-b433-b6f2a518af66 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.638789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.639447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.639737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.640015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.640758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.642887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.673559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1078/2183] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:09 2022] POST /identity/v3/projects => generated 386 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:09.675529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.692017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0280b9e-79b4-4f2b-83a1-300a709e225b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.712033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:09.761280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.761971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.762260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.762585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.763303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.765349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.798420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1106/2184] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:09 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:09.804807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.821302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04639cae-4d7a-4865-a06b-abe2a4b562f4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.826291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.837362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.837362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.837362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.837362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.837362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.842679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1079/2185] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:09.848579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.867416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbc505-76a6-487d-b30c-e2e55c444ab4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.874019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.874741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.875028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.875303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.876083 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.877783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e01ba-74ad-454d-bc66-ab8db50017c9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.889688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1107/2186] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:09 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:09.894532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:09.906293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236b8fe-65c9-4fff-99b3-05231817143e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:09.911429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:09.912339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:09.912653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:09.912992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] PATH_INFO: `/v3/projects/4c6eac31010147938e918117e1793def/users/c4dcde97c4b64b0daf2a6134599f0067/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:09.936429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6eac31010147938e918117e1793def, user_id=c4dcde97c4b64b0daf2a6134599f0067, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:09.941205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:09.958700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1080/2187] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:09 2022] PUT /identity/v3/projects/4c6eac31010147938e918117e1793def/users/c4dcde97c4b64b0daf2a6134599f0067/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:10.030698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.030971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.031261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.066625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] MFA Rules not processed for user `c4dcde97c4b64b0daf2a6134599f0067`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:10.068458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.161678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1108/2188] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:10.167197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.175394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.254475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d89980-cc69-4e68-97d5-6e17d8b1c0c0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.259956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.260667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.260955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.261236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.262015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.264230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.302110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.302678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1081/2189] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/projects => generated 382 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:10.314727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14d49-b4d8-43c0-973c-895ffea14f86 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.396318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.397073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.397365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.397649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.398359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.400405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.424810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1109/2190] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:10.428672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.440007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893ca91-5ba2-42a5-9204-52466c88d9c4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.445363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.446100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.446875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.447159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.447901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.449583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.461676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1082/2191] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:10.465816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.495479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6060c03b-85e3-4a61-9bfb-fd66dd90cd94 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.500523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.501796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.502086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.502495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] PATH_INFO: `/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028/users/a8bab84d90964f8d95f35debed651f29/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.526563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cd0f6a9d0844d485ada19b0f0aa028, user_id=a8bab84d90964f8d95f35debed651f29, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.529493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.532329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.548890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1110/2192] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:10 2022] PUT /identity/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028/users/a8bab84d90964f8d95f35debed651f29/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:10.553884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.565109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1952bd-c863-4331-a95d-548782756f4f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.638093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.638953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.639295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.639633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.640601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.642389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506e12d-596f-40e1-b78f-2052bfdb8970 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.656066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1083/2193] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/roles => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:10.661657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.679768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15df8eb-dd50-443c-b11d-ee52dd181aeb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.688293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.689762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.690183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.690703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] PATH_INFO: `/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028/users/a8bab84d90964f8d95f35debed651f29/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.694544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cd0f6a9d0844d485ada19b0f0aa028, user_id=a8bab84d90964f8d95f35debed651f29, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:10.700717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:10.718513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1111/2194] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:10 2022] PUT /identity/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028/users/a8bab84d90964f8d95f35debed651f29/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:10.729817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.730110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.730420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:10.761300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] MFA Rules not processed for user `a8bab84d90964f8d95f35debed651f29`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:10.762532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.842428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:10.847803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1084/2195] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:10.862552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:10.865285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:10.935991 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223097-2792-4b1c-afc2-a5ccdaae47a8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:10.940163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:10.940938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:10.941138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:10.941422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:11.011583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:11.014229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:11.029988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1112/2196] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:14.751721 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:14.772977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f69ada-fe3d-422b-8c15-400a81b196ed None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:14.777477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:14.778256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:14.778806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:14.779155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:14.865563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:14.867286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef71db-fdfc-4328-a58d-7426ccdf5d5f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:14.880549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1085/2197] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:15.113787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.115685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.218189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9270a-1d1f-4d30-9e6a-4f1f0acac059 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.223820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.224765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.225051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.225327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] PATH_INFO: `/v3/users/c61ef21c8d934a4d9101c2c086ab8936` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.226581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61ef21c8d934a4d9101c2c086ab8936)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.229312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.293732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.317817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61ef21c8d934a4d9101c2c086ab8936'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:15.338845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61ef21c8d934a4d9101c2c086ab8936'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:15.352977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61ef21c8d934a4d9101c2c086ab8936'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:15.353713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61ef21c8d934a4d9101c2c086ab8936'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:15.354375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61ef21c8d934a4d9101c2c086ab8936'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:15.371541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1113/2198] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:15 2022] DELETE /identity/v3/users/c61ef21c8d934a4d9101c2c086ab8936 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:15.378257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.378883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.380229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.407819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:15.409680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.509953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1086/2199] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:15.518406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.520409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.593891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.595251 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.623982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ba20f-1a88-48e1-a927-0f630f5c7343 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.628568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.629238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.629522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.629801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.647525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.651449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.664486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1114/2200] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:15.696978 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3dadb-b02c-4803-bfce-5b3aa7ab29a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.705322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.706124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.706553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.707007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.709268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.763483 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:15.829888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.831826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891cff4-961b-4da3-9540-8c4148ec7e25 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:15.843815 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1087/2201] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:15.855590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:15.858136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:15.890664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f686100-e6ec-42bf-9de6-1613a56f70fa service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:15.902933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:15.906392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:15.908074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:15.909436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] PATH_INFO: `/v3/users/951050fed8f54d20bd84111e6cb1a899` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:15.915287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=951050fed8f54d20bd84111e6cb1a899)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:15.921094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.028832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951050fed8f54d20bd84111e6cb1a899'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.053025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951050fed8f54d20bd84111e6cb1a899'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.063317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951050fed8f54d20bd84111e6cb1a899'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.064444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951050fed8f54d20bd84111e6cb1a899'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.065183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951050fed8f54d20bd84111e6cb1a899'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.085115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1115/2202] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:15 2022] DELETE /identity/v3/users/951050fed8f54d20bd84111e6cb1a899 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:16.093277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.093577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.093849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.123198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:16.128876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.160694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.162291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.214849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.237790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1088/2203] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:16.254084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.257658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.266360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdfc5c-69e9-4c53-a209-893edbe9e8e8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.272188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.273116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.273549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.273820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] PATH_INFO: `/v3/projects/396a2cae8abb4fa08c8f7a3b5fe7c4c6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.275325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396a2cae8abb4fa08c8f7a3b5fe7c4c6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.277603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.378234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396a2cae8abb4fa08c8f7a3b5fe7c4c6', 'request_id': 'req-79904f9a-79ef-4eb5-92c8-71c65fafd001'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.390012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a826c-8858-46b5-9a92-63f1da6a3b7b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.392581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396a2cae8abb4fa08c8f7a3b5fe7c4c6', 'request_id': 'req-79904f9a-79ef-4eb5-92c8-71c65fafd001'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.402185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396a2cae8abb4fa08c8f7a3b5fe7c4c6', 'request_id': 'req-79904f9a-79ef-4eb5-92c8-71c65fafd001'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.414286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] The token cache is being invalidate because project 396a2cae8abb4fa08c8f7a3b5fe7c4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:16.414676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.415936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-79904f9a-79ef-4eb5-92c8-71c65fafd001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:16.417723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1116/2204] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:16 2022] DELETE /identity/v3/projects/396a2cae8abb4fa08c8f7a3b5fe7c4c6 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:16.422841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db708-767e-49d8-9ea0-a4ebb5d70a00 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.423131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db708-767e-49d8-9ea0-a4ebb5d70a00 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.423420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912db708-767e-49d8-9ea0-a4ebb5d70a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.444108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-912db708-767e-49d8-9ea0-a4ebb5d70a00 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:16.446058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-912db708-767e-49d8-9ea0-a4ebb5d70a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.466332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.467717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.468577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.469169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.472877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.540789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1117/2205] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:16.543091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.548564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.548860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.549138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.569338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:16.570597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:16.578157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.580932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.582164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1118/2206] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:16.586234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.599572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d009-8a03-4722-8b10-d802fa091295 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.603136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1089/2207] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:16.605726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.606408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.606695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.606976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.607719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:16.608031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.609724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.624425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1119/2208] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:16.627797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.638473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9aa13c-f2c6-4fbe-be88-863c09867290 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.643618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.644305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.644622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.644942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.645656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.647626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.680431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1090/2209] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/projects => generated 376 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:16.683449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.694667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f80410-5433-4e17-bb42-b22a32f4a43f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.742508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:16.770683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.771393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.771738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.772024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.772789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.775381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.808002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1120/2210] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:16.809761 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.823655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac67e3-a739-41c1-9fa7-30786b652ada admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.828767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.829534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.830038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.830383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.831410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.833176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.850366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1091/2211] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:16.855514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.871998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000dcaba-0091-47ec-b257-48ee01c0188d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.882298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.883063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.884021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.884396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.885494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.888436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6124a-395c-4cb9-bd65-a3c0c03d2b4d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.917028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1121/2212] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:16 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:16.917605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:16.928633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1bcea-6380-4b93-8c81-b69b4dd1df13 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:16.933832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:16.934831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:16.935194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:16.935540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] PATH_INFO: `/v3/projects/2b4d322cc014464da21503514cd08b91/users/6f67b0bec1d74cf1a07415665e782d2e/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:16.956843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4d322cc014464da21503514cd08b91, user_id=6f67b0bec1d74cf1a07415665e782d2e, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:16.962141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:16.982933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1092/2213] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:16 2022] PUT /identity/v3/projects/2b4d322cc014464da21503514cd08b91/users/6f67b0bec1d74cf1a07415665e782d2e/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:17.001179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.001533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.002034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.036273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] MFA Rules not processed for user `6f67b0bec1d74cf1a07415665e782d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:17.037563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.132552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1122/2214] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:17.136802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.139593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.169854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.171957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.276571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba23487-aecb-4628-881a-5821ae6b78fd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.281975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.282750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.282906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846a7f5-b5d3-4ca4-8433-edc325cb1835 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.283182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.283533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.289170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.291717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.292026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.292316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] PATH_INFO: `/v3/projects/49c1740233274b27818f44061d51dfcf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.293952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.294298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c1740233274b27818f44061d51dfcf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.295569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62f073-a943-42ed-a856-d92d9dca1608 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.296936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.312709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1123/2215] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:17.337073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.337496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.337815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.358959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] MFA Rules not processed for user `9c0fb73a262843f89285a6e161a1abed`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:17.360868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.376013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c1740233274b27818f44061d51dfcf', 'request_id': 'req-054f9430-58ac-4e44-9322-bd0c886828e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.384716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c1740233274b27818f44061d51dfcf', 'request_id': 'req-054f9430-58ac-4e44-9322-bd0c886828e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.398704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c1740233274b27818f44061d51dfcf', 'request_id': 'req-054f9430-58ac-4e44-9322-bd0c886828e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.415698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] The token cache is being invalidate because project 49c1740233274b27818f44061d51dfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:17.416510 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.417448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.420218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1093/2216] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:17 2022] DELETE /identity/v3/projects/49c1740233274b27818f44061d51dfcf => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:17.428243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:17.434019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:17.436553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.451913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:17.489022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1124/2217] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:17.574058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f9430-58ac-4e44-9322-bd0c886828e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:17.579250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:17.580151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:17.580467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:17.580788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] PATH_INFO: `/v3/users/afdce6bde39449708eb58f56e62fa79d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:17.582426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdce6bde39449708eb58f56e62fa79d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:17.596713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:17.729744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdce6bde39449708eb58f56e62fa79d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.730745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdce6bde39449708eb58f56e62fa79d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.748812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdce6bde39449708eb58f56e62fa79d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.767128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdce6bde39449708eb58f56e62fa79d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.791639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdce6bde39449708eb58f56e62fa79d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:17.803339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1094/2218] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:17 2022] DELETE /identity/v3/users/afdce6bde39449708eb58f56e62fa79d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:18.533369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.548973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb28c9-67fe-425d-8afb-3e70ba6f0095 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.636182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.637295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.637687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.638186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] PATH_INFO: `/v3/projects/4cc62654b6e74b4a9b09c16149f9f5d7` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.640396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc62654b6e74b4a9b09c16149f9f5d7)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.642513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.713943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc62654b6e74b4a9b09c16149f9f5d7', 'request_id': 'req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.723857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc62654b6e74b4a9b09c16149f9f5d7', 'request_id': 'req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.733657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc62654b6e74b4a9b09c16149f9f5d7', 'request_id': 'req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.747726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] The token cache is being invalidate because project 4cc62654b6e74b4a9b09c16149f9f5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:18.748174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.749085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.751150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1125/2219] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:18 2022] DELETE /identity/v3/projects/4cc62654b6e74b4a9b09c16149f9f5d7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:18.756072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:18.764886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:18.777081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345287e-e50d-4a1b-9667-2944f3818920 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:18.861658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:18.861658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:18.861658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:18.861658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] PATH_INFO: `/v3/users/8df9e5f33fe349b0ae0d9066f032e2bb` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:18.862127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df9e5f33fe349b0ae0d9066f032e2bb)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:18.862773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:18.921352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:18.954154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df9e5f33fe349b0ae0d9066f032e2bb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.955212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df9e5f33fe349b0ae0d9066f032e2bb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.984733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df9e5f33fe349b0ae0d9066f032e2bb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:18.997216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df9e5f33fe349b0ae0d9066f032e2bb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.008098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-284f5c2d-430b-438c-b1e6-46987e41757b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df9e5f33fe349b0ae0d9066f032e2bb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.017088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1095/2220] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:18 2022] DELETE /identity/v3/users/8df9e5f33fe349b0ae0d9066f032e2bb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:19.385065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.386611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:19.399572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3ba21-f6ca-42b4-b038-2eebf44b7c07 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.461363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.462240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.462530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.462811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] PATH_INFO: `/v3/projects/79c6e276ef4a4809bebe537e4d8dd126` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.464048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c6e276ef4a4809bebe537e4d8dd126)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.466006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.502014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:19.520930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c6e276ef4a4809bebe537e4d8dd126', 'request_id': 'req-6ad5c583-fae3-416e-80a3-dced4fdf9a40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.528909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c6e276ef4a4809bebe537e4d8dd126', 'request_id': 'req-6ad5c583-fae3-416e-80a3-dced4fdf9a40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.536399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c6e276ef4a4809bebe537e4d8dd126', 'request_id': 'req-6ad5c583-fae3-416e-80a3-dced4fdf9a40'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.549053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] The token cache is being invalidate because project 79c6e276ef4a4809bebe537e4d8dd126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:19.549351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.550041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6ad5c583-fae3-416e-80a3-dced4fdf9a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:19.551672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1126/2221] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:19 2022] DELETE /identity/v3/projects/79c6e276ef4a4809bebe537e4d8dd126 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:19.557144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.557505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.557865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.581295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:19.582533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:19.649468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1096/2222] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:19.660456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.660752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.661039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.682084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:19.683318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:19.691808 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1127/2223] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:19.697305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.708277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e9542-03bb-41e7-a88a-20c03d782174 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.713800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.714789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.715094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.715380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.716211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:19.716577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.718376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.733058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1097/2224] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:19.738888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.753609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471169f6-b3bd-4c5f-9dc5-f0534fb57e10 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.760708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.761471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.761767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.762081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.762769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.764762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.804348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1128/2225] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/projects => generated 396 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:19.809374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.821574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f969b08a-244e-4caa-9e00-a1b828828a2d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.889511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.890208 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.890547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.890831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.891610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.894177 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.924184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1098/2226] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:19 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:19.929236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.942256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121d99-f68e-4489-8047-ab2e0399df36 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.947492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.948182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.948508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.948793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.949610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.951136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:19.966242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1129/2227] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:19.968723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:19.980838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdfb91-ffe9-4042-85ba-53e71ff72841 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:19.985856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:19.986562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:19.986848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:19.987129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:19.987866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:19.989668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382437d-3ae1-4504-8468-ef8df5176b95 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.005596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1099/2228] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:19 2022] GET /identity/v3/roles => generated 1427 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:20.012120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.025845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df275de-a3c1-4d5d-a0dd-f85bc2def71f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.033072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.034671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.035153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.035528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] PATH_INFO: `/v3/projects/519f407a23b4455189b13e394dada592/users/ab9a0723a99c4c4d8c28b4c234264230/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.059956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=519f407a23b4455189b13e394dada592, user_id=ab9a0723a99c4c4d8c28b4c234264230, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.065369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.095159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1130/2229] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:20 2022] PUT /identity/v3/projects/519f407a23b4455189b13e394dada592/users/ab9a0723a99c4c4d8c28b4c234264230/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:20.099116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c17e-bb0c-4cf6-813c-ff8abf6d7421 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.099403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c17e-bb0c-4cf6-813c-ff8abf6d7421 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.099707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38c17e-bb0c-4cf6-813c-ff8abf6d7421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.145593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:20.149580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cb38c17e-bb0c-4cf6-813c-ff8abf6d7421 None None] MFA Rules not processed for user `ab9a0723a99c4c4d8c28b4c234264230`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:20.153552 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb38c17e-bb0c-4cf6-813c-ff8abf6d7421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:20.232126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1100/2230] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:20.245077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:20.246878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:20.311243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f55d-8f55-4f93-b975-f74238ebe0ea admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:20.315850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:20.316571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:20.316880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:20.317189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:20.327028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:20.328555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:20.340072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1131/2231] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:24.442019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6c6-e8ed-4736-a6ee-824c43721464 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:24.442567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6c6-e8ed-4736-a6ee-824c43721464 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:24.442567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd6c6-e8ed-4736-a6ee-824c43721464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:24.463767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b11cd6c6-e8ed-4736-a6ee-824c43721464 None None] MFA Rules not processed for user `6f67b0bec1d74cf1a07415665e782d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:24.464948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b11cd6c6-e8ed-4736-a6ee-824c43721464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:24.558446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1101/2232] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:26.978153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:26.979793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:27.048712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:27.054890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c9134-7a31-4296-83bc-65b155b09d47 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.063125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.064454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.065048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.065403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] PATH_INFO: `/v3/users/e80e990d139a40a284aaddfc95891c16` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.066940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e80e990d139a40a284aaddfc95891c16)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.069427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.126231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e80e990d139a40a284aaddfc95891c16'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.139990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e80e990d139a40a284aaddfc95891c16'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.148784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e80e990d139a40a284aaddfc95891c16'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.149795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e80e990d139a40a284aaddfc95891c16'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.150768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e80e990d139a40a284aaddfc95891c16'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:27.174843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1132/2233] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:26 2022] DELETE /identity/v3/users/e80e990d139a40a284aaddfc95891c16 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:27.182363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.182947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.182947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.203076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:27.204484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:27.295814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1102/2234] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:27.312941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:27.316215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:27.442584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174f3bd-534e-45b3-8107-f17850bfe8b7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:27.450117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:27.452723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:27.453227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:27.453719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:27.496122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:27.503471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:27.544248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1133/2235] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:28.289734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.291373 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:28.304132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb9e300-c19c-4d65-b49d-ced560b89069 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.315618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.316813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.317102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.317377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] PATH_INFO: `/v3/projects/1b926bddf2c1496cbd427194e724f673` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.319224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b926bddf2c1496cbd427194e724f673)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.321850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.374841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.379700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b926bddf2c1496cbd427194e724f673', 'request_id': 'req-f55f5359-cbb4-4ce0-9587-9f0d3308873d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.386553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b926bddf2c1496cbd427194e724f673', 'request_id': 'req-f55f5359-cbb4-4ce0-9587-9f0d3308873d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.395564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b926bddf2c1496cbd427194e724f673', 'request_id': 'req-f55f5359-cbb4-4ce0-9587-9f0d3308873d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.409209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] The token cache is being invalidate because project 1b926bddf2c1496cbd427194e724f673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:28.409507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.410187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.411822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1103/2236] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:28 2022] DELETE /identity/v3/projects/1b926bddf2c1496cbd427194e724f673 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:28.416141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:28.426684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5475c3-6795-4c5b-8c5b-a7da83f2dbe0 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:28.493740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:28.494849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:28.495230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:28.495556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] PATH_INFO: `/v3/users/c4dcde97c4b64b0daf2a6134599f0067` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:28.497066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4dcde97c4b64b0daf2a6134599f0067)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:28.499068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:28.524741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:28.559141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4dcde97c4b64b0daf2a6134599f0067'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.574861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4dcde97c4b64b0daf2a6134599f0067'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.583254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4dcde97c4b64b0daf2a6134599f0067'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.584103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4dcde97c4b64b0daf2a6134599f0067'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.584735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4dcde97c4b64b0daf2a6134599f0067'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:28.598962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1134/2237] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:28 2022] DELETE /identity/v3/users/c4dcde97c4b64b0daf2a6134599f0067 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:29.122614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.126622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.171942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f5359-cbb4-4ce0-9587-9f0d3308873d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.256339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.257261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.257633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.257918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] PATH_INFO: `/v3/projects/4c6eac31010147938e918117e1793def` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.260407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6eac31010147938e918117e1793def)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.264213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.338008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6eac31010147938e918117e1793def', 'request_id': 'req-ca555125-15ab-45b0-8a03-a281552688f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.345335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6eac31010147938e918117e1793def', 'request_id': 'req-ca555125-15ab-45b0-8a03-a281552688f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.355447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6eac31010147938e918117e1793def', 'request_id': 'req-ca555125-15ab-45b0-8a03-a281552688f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.371279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] The token cache is being invalidate because project 4c6eac31010147938e918117e1793def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:29.372060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.373235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.375989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1104/2238] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:29 2022] DELETE /identity/v3/projects/4c6eac31010147938e918117e1793def => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:29.382101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.384775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:29.409346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e43be4-8649-4bd9-b621-6c9c1239c288 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:29.502275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:29.503169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:29.503455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:29.503732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] PATH_INFO: `/v3/users/a8bab84d90964f8d95f35debed651f29` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:29.505036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8bab84d90964f8d95f35debed651f29)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:29.506992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:29.568697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8bab84d90964f8d95f35debed651f29'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.593485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8bab84d90964f8d95f35debed651f29'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.607347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8bab84d90964f8d95f35debed651f29'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.609887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8bab84d90964f8d95f35debed651f29'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.610724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8bab84d90964f8d95f35debed651f29'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:29.624341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1135/2239] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:29 2022] DELETE /identity/v3/users/a8bab84d90964f8d95f35debed651f29 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:29.977243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:29.979447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:30.001127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca555125-15ab-45b0-8a03-a281552688f7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:30.087170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:30.088192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:30.088539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:30.088893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] PATH_INFO: `/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:30.090342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cd0f6a9d0844d485ada19b0f0aa028)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:30.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:30.095606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:30.176347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cd0f6a9d0844d485ada19b0f0aa028', 'request_id': 'req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:30.185715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cd0f6a9d0844d485ada19b0f0aa028', 'request_id': 'req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:30.197616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cd0f6a9d0844d485ada19b0f0aa028', 'request_id': 'req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:30.217749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] The token cache is being invalidate because project d3cd0f6a9d0844d485ada19b0f0aa028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:30.218059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:30.218752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c5724bbd-180e-4b72-9124-a5c1d2e0a6d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:30.220355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1105/2240] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:29 2022] DELETE /identity/v3/projects/d3cd0f6a9d0844d485ada19b0f0aa028 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:39.620730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=18,keystone:SELECT=73,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:40.209178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:40.671517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:40.673654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:40.707751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1d05b-fc54-4204-a182-2660487bd4fa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:40.865822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:40.867082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:40.867336 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:40.868311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] PATH_INFO: `/v3/users/ab9a0723a99c4c4d8c28b4c234264230` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:40.869883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9a0723a99c4c4d8c28b4c234264230)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:40.872315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:40.969186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9a0723a99c4c4d8c28b4c234264230'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:40.993770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9a0723a99c4c4d8c28b4c234264230'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.005488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9a0723a99c4c4d8c28b4c234264230'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.006320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9a0723a99c4c4d8c28b4c234264230'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.006983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9a0723a99c4c4d8c28b4c234264230'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.026009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1136/2241] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:40 2022] DELETE /identity/v3/users/ab9a0723a99c4c4d8c28b4c234264230 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:41.030443 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.030713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.031240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.056127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:41.057514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:41.157293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1106/2242] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:41.170636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.174360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:41.263427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e0508-1087-4444-850c-1693adfac290 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.267419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.268101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.268438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.268725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.279777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.281491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.294579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1137/2243] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:41.725705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:41.727966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:41.750332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ef93e-2377-4318-ad0e-9618c2266985 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:41.759591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:41.761250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:41.761800 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:41.762301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] PATH_INFO: `/v3/projects/519f407a23b4455189b13e394dada592` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:41.764687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519f407a23b4455189b13e394dada592)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:41.768633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:41.851197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519f407a23b4455189b13e394dada592', 'request_id': 'req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.858623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519f407a23b4455189b13e394dada592', 'request_id': 'req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.870793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519f407a23b4455189b13e394dada592', 'request_id': 'req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.890007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] The token cache is being invalidate because project 519f407a23b4455189b13e394dada592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:41.890425 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.891351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-efdfaef1-d7fd-4da5-af80-e13e1c6ef4f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:41.893947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1107/2244] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:41 2022] DELETE /identity/v3/projects/519f407a23b4455189b13e394dada592 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:43.628462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:43.630989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:43.656187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a172e-9662-4ca3-9646-470794b7df27 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:43.691972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:43.775275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:43.777256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.777761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.778259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] PATH_INFO: `/v3/users/10da7a2d618c4a71bf10e85b69881942` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.780690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=10da7a2d618c4a71bf10e85b69881942)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:43.784719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:43.877256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10da7a2d618c4a71bf10e85b69881942'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.910099 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10da7a2d618c4a71bf10e85b69881942'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.925713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10da7a2d618c4a71bf10e85b69881942'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.927025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10da7a2d618c4a71bf10e85b69881942'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.928631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10da7a2d618c4a71bf10e85b69881942'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:43.950335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1138/2245] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:43 2022] DELETE /identity/v3/users/10da7a2d618c4a71bf10e85b69881942 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:43.956207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:43.957095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:43.957449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:43.985568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:43.987534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.110335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1108/2246] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:44.124090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.126260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.232936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e862e-e169-4c26-8a2d-4241eb32af6b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.238021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.238950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.239392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.239763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.253094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.254631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.266554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1139/2247] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:44.727355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.729524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:44.747393 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ee8d5-801f-400a-be96-f4bc8f92068a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:44.757532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:44.759234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:44.759591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:44.759896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] PATH_INFO: `/v3/projects/671df32b5f2741a489950b927f54c0ce` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:44.762348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] RBAC: Authorizing `identity:delete_project(project_id=671df32b5f2741a489950b927f54c0ce)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:44.764043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:44.813586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:44.870193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671df32b5f2741a489950b927f54c0ce', 'request_id': 'req-672752e6-8c1f-4059-8d59-a1452026482f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.871153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671df32b5f2741a489950b927f54c0ce', 'request_id': 'req-672752e6-8c1f-4059-8d59-a1452026482f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.889967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671df32b5f2741a489950b927f54c0ce', 'request_id': 'req-672752e6-8c1f-4059-8d59-a1452026482f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.910463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] The token cache is being invalidate because project 671df32b5f2741a489950b927f54c0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:44.911039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.912043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:44.914212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1109/2248] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:44 2022] DELETE /identity/v3/projects/671df32b5f2741a489950b927f54c0ce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:44.919108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:44.943697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902dd931-daf9-4898-aaa8-4c147599cfe3 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.024597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:45.047352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.048258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.048588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.048924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] PATH_INFO: `/v3/users/13a5354e8f9540c7afba45650bbcaa89` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.050757 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a5354e8f9540c7afba45650bbcaa89)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.053706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.149681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a5354e8f9540c7afba45650bbcaa89'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.176508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a5354e8f9540c7afba45650bbcaa89'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.187995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a5354e8f9540c7afba45650bbcaa89'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.189150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a5354e8f9540c7afba45650bbcaa89'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.189899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cb81c4a9-7589-4d61-b397-051f7b7b36ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a5354e8f9540c7afba45650bbcaa89'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.217425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1140/2249] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:44 2022] DELETE /identity/v3/users/13a5354e8f9540c7afba45650bbcaa89 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:45.569694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.572156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.588843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672752e6-8c1f-4059-8d59-a1452026482f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.672344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.673394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.673726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.674052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] PATH_INFO: `/v3/projects/9068235c46124dfaa1c638dd320aed07` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.675568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9068235c46124dfaa1c638dd320aed07)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.677709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.737675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9068235c46124dfaa1c638dd320aed07', 'request_id': 'req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.747902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9068235c46124dfaa1c638dd320aed07', 'request_id': 'req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.761820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9068235c46124dfaa1c638dd320aed07', 'request_id': 'req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.777762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] The token cache is being invalidate because project 9068235c46124dfaa1c638dd320aed07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:45.778043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.778744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9db5347-670c-4c1d-ad2d-3f5e8b80595a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:45.780406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1110/2250] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:45 2022] DELETE /identity/v3/projects/9068235c46124dfaa1c638dd320aed07 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:45.786521 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.786813 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.787084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.809120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.810372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.923261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1141/2251] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:45.926415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.926789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.927081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.948757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:45.950044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:45.958902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1111/2252] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:45.963483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:45.974093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4da0a70-58b6-4951-9dbc-9bb194cb9641 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:45.979591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:45.980274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:45.980594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:45.980865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:45.981619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:45.981927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:45.983665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:45.998525 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1142/2253] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:43:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:43:46.004709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.019434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d227292-ad8d-4224-8a51-9e6e0a1d2dfd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.025317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.025986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.026276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.026554 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.027426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.029415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.058127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1112/2254] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/projects => generated 392 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:46.062946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.074634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe5aab-61cc-4d85-8426-6bcfcd9acccf admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.128914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:46.143061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.143753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.144234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.144556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.145258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.147203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.168866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1143/2255] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:46.173674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.184651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c9d66-6a16-40f4-adcb-d82f643cae9b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.189996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.190668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.190953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.191227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.192081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.193670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.196943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:46.207586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1113/2256] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:46.215825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.227847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247035d6-e74e-464e-bb93-5ad0759316ca admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.232955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.233644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.233936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.234220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.234962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.236621 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d954ff-be8f-4383-90c1-34812f2e644f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.248499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1144/2257] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:46.252640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.263725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5ce23-8eaa-4c93-bc4f-f7b321c975ea admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.268670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.269683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.269976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.270260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] PATH_INFO: `/v3/projects/dc871d4652924040ab0b0d58f43069bd/users/c82b313282ea46e7866b7ab5335bb03a/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.286472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc871d4652924040ab0b0d58f43069bd, user_id=c82b313282ea46e7866b7ab5335bb03a, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.289741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.305959 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1114/2258] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:46 2022] PUT /identity/v3/projects/dc871d4652924040ab0b0d58f43069bd/users/c82b313282ea46e7866b7ab5335bb03a/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:46.321443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.321865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.322252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.363066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] MFA Rules not processed for user `c82b313282ea46e7866b7ab5335bb03a`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:46.365104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:46.457773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1145/2259] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:46.464779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.561999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f03ca6-9883-454b-a367-4efc26d5f55e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.570110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.571272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.571796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.572301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.573714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.577627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.611926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1115/2260] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/projects => generated 392 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:46.616475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.627996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83844df-7102-4f32-9025-d5e746178b49 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.698337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.699033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.699324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.699610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.700327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.702426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.725576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1146/2261] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/users => generated 303 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:46.729870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.741322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9bd7d6-d1e6-4c5f-9b8c-f103ab769ffa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.746979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.747646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.747935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.748217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.749031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.750685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.763697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1116/2262] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:46.769144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.786281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8b0d5-0a01-40e8-a9be-eace126c8be3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.791187 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.792148 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.792435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.792718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] PATH_INFO: `/v3/projects/f65a6e049c4446f08bc843e0ed70219f/users/086ab579a9144e199139888ac6e3e1ef/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.813044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65a6e049c4446f08bc843e0ed70219f, user_id=086ab579a9144e199139888ac6e3e1ef, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.815743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.831975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1147/2263] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:46 2022] PUT /identity/v3/projects/f65a6e049c4446f08bc843e0ed70219f/users/086ab579a9144e199139888ac6e3e1ef/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:46.836805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.848806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10cfcab-a7db-4885-81cd-2cadeda03fc3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.915643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.916356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.916672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.916952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.917698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.919342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c2a4e-04ae-46d1-afb5-df0ba85b29a3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.931068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1117/2264] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:46 2022] GET /identity/v3/roles => generated 1427 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:43:46.935554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:46.948107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d2d8c-4279-407c-bcd8-6c4cc549b821 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:46.953276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:46.954151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.954435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.954710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] PATH_INFO: `/v3/projects/f65a6e049c4446f08bc843e0ed70219f/users/086ab579a9144e199139888ac6e3e1ef/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:46.956871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65a6e049c4446f08bc843e0ed70219f, user_id=086ab579a9144e199139888ac6e3e1ef, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:46.959532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:46.971835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1148/2265] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:46 2022] PUT /identity/v3/projects/f65a6e049c4446f08bc843e0ed70219f/users/086ab579a9144e199139888ac6e3e1ef/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:46.983069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:46.983397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:46.983714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.026562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] MFA Rules not processed for user `086ab579a9144e199139888ac6e3e1ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:47.027817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.082355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:47.127266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1118/2266] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:47.139224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:47.141102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.156029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:47.211423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc917f-f445-4770-a3c0-dbf3ae7c30e7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:47.216550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:47.217638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.218086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.218504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.231101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:47.232738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:47.245334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1149/2267] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:47.298188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:47.299771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:47.318658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc506a-20b2-424b-8b6e-9d7f04d4cf5b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:47.324711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:47.325772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:47.326265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:47.326747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:47.433064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:47.435941 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320757c-98f0-44a5-afb2-44a28a65b77b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:47.448790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1119/2268] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:52.289960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.371942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8270cc-deb3-4041-b62c-b7253bda28ce service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.377251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.378657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.379144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.379434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] PATH_INFO: `/v3/users/c82b313282ea46e7866b7ab5335bb03a` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.381030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82b313282ea46e7866b7ab5335bb03a)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.383182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.457487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82b313282ea46e7866b7ab5335bb03a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:52.476696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82b313282ea46e7866b7ab5335bb03a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:52.487749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82b313282ea46e7866b7ab5335bb03a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:52.488636 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82b313282ea46e7866b7ab5335bb03a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:52.489518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82b313282ea46e7866b7ab5335bb03a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:52.514164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1150/2269] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:52 2022] DELETE /identity/v3/users/c82b313282ea46e7866b7ab5335bb03a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:52.519472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.520059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.520059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.549582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:52.552996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:52.658400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1120/2270] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:52.669633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:52.671253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:52.777326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:52.837935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1717b851-61a8-4523-899a-7489bab15529 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:52.855028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:52.856888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:52.857591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:52.858475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:52.882919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:52.887677 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:52.916555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1151/2271] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:43:53.505150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.506706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:53.519898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf72e9-abd8-49a1-86ff-b3c808dd86ec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.525653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.526841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.527218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.527758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] PATH_INFO: `/v3/projects/dc871d4652924040ab0b0d58f43069bd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.529540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc871d4652924040ab0b0d58f43069bd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.531899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.583956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc871d4652924040ab0b0d58f43069bd', 'request_id': 'req-880c538e-87cd-48a9-b4af-91680597fe6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.589543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc871d4652924040ab0b0d58f43069bd', 'request_id': 'req-880c538e-87cd-48a9-b4af-91680597fe6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.593173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:53.597462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc871d4652924040ab0b0d58f43069bd', 'request_id': 'req-880c538e-87cd-48a9-b4af-91680597fe6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.612296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] The token cache is being invalidate because project dc871d4652924040ab0b0d58f43069bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:53.612771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.613333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.615404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1121/2272] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:53 2022] DELETE /identity/v3/projects/dc871d4652924040ab0b0d58f43069bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:53.620283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:53.630786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581e3ee-478e-45f6-98d4-e3980fc9d27e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:53.703304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:53.704316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:53.704702 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:53.705047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] PATH_INFO: `/v3/users/086ab579a9144e199139888ac6e3e1ef` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:53.706389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=086ab579a9144e199139888ac6e3e1ef)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:53.708798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:53.780289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086ab579a9144e199139888ac6e3e1ef'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.796473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086ab579a9144e199139888ac6e3e1ef'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.805712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086ab579a9144e199139888ac6e3e1ef'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.806734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086ab579a9144e199139888ac6e3e1ef'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.807781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-87ed89d1-b4af-4b7d-ae45-99d35d865f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086ab579a9144e199139888ac6e3e1ef'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:53.826800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1152/2273] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:43:53 2022] DELETE /identity/v3/users/086ab579a9144e199139888ac6e3e1ef => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:54.141977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.143731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.166675 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c538e-87cd-48a9-b4af-91680597fe6b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.261091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.262618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.263120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.263606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] PATH_INFO: `/v3/projects/f65a6e049c4446f08bc843e0ed70219f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.265877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65a6e049c4446f08bc843e0ed70219f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.269839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.357054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65a6e049c4446f08bc843e0ed70219f', 'request_id': 'req-25144e11-8648-43db-a3c6-899c9c29da12'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.370796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65a6e049c4446f08bc843e0ed70219f', 'request_id': 'req-25144e11-8648-43db-a3c6-899c9c29da12'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.379935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65a6e049c4446f08bc843e0ed70219f', 'request_id': 'req-25144e11-8648-43db-a3c6-899c9c29da12'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.394453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] The token cache is being invalidate because project f65a6e049c4446f08bc843e0ed70219f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:43:54.394750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.395472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-25144e11-8648-43db-a3c6-899c9c29da12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:43:54.397171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1122/2274] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:43:54 2022] DELETE /identity/v3/projects/f65a6e049c4446f08bc843e0ed70219f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:54.402847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.403254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.403601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.424180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:54.425487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.487072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:54.501657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1153/2275] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:54.511010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.511329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.511615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.532618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:54.533869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.541963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1123/2276] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:54.546347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.556413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d12b1-8476-4309-96a2-41eecdabd97d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.560970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.561622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.561905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.562184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.562916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:43:54.563223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.564833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.579782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1154/2277] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:43:54.581606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.592228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52a0fd-da49-4790-9882-e9bbaf816f33 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.597403 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.598143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.598431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.598716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.599428 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.601438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.630813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1124/2278] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/projects => generated 384 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:54.635823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.646092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f112a-a426-4381-af7a-289ecbe84185 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.706774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.707454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.707743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.708022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.708762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.710680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.730357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1155/2279] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:54.739656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.750986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a53e4-4f1b-4cb0-8799-c563047aefed admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.755698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.756354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.756683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.756963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.757689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.759913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.770871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1125/2280] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:54.774983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.784956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ff603-0565-41ba-8e1f-0f4c1462ab35 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.789538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.790184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.790468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.790747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.791473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.793104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049a3f3-8302-473f-8c7e-8a07eee9dad4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.802994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1156/2281] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:54 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:54.807989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:54.818628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b53f4-a253-4ee6-a3ab-8738d202504d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:54.824125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:54.825054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.825337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.825612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] PATH_INFO: `/v3/projects/3912566f103f44a7a2f3008d8d456e0f/users/4e5b1d1bb5c04cdd8154996e0a6afa73/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.841259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3912566f103f44a7a2f3008d8d456e0f, user_id=4e5b1d1bb5c04cdd8154996e0a6afa73, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:54.843831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:54.860047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1126/2282] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:54 2022] PUT /identity/v3/projects/3912566f103f44a7a2f3008d8d456e0f/users/4e5b1d1bb5c04cdd8154996e0a6afa73/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:54.871755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:54.872071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:54.872294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:54.902457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] MFA Rules not processed for user `4e5b1d1bb5c04cdd8154996e0a6afa73`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:54.903714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:54.977559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1157/2283] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:43:54.982463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.004181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.054665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fcead-e681-4052-aa81-c8b343e926da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.059932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.060640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.060930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.061350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.062067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.064109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.100609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1127/2284] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:43:54 2022] POST /identity/v3/projects => generated 382 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:43:55.104450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.116774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada0ace-cd8c-4ce4-b07c-775ad9d44061 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.168596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.180645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.181876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.182165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.182445 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.183181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.185191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.206539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1158/2285] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:43:55 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:43:55.210905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.226064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b951-f394-438b-87dc-dbd9acf8668d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.231908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.232634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.232931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.233214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.233956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.235657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.249755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1128/2286] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:55.254229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.264591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d44cc-95a1-4341-a2d6-1d31e5f8d7da admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.269470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.270362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.270647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.270927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] PATH_INFO: `/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f/users/73691a344eef4191aadb2dd6f7a1278f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.289696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa189f2d7041f3b6237b5bad32d47f, user_id=73691a344eef4191aadb2dd6f7a1278f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.292585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.311572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1159/2287] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:55 2022] PUT /identity/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f/users/73691a344eef4191aadb2dd6f7a1278f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:43:55.315747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.326926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c8ef-30f4-4ba9-89f4-0d3efd2da9eb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.389549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.390145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.390432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.390705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.391438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.393113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9066b4-8500-487a-85f5-c10a557fa5b9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.411473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1129/2288] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/roles => generated 1427 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:43:55.412816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.424334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc70a8-69ad-49f4-864f-98dcbd5c01ff admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.429762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.430967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.431257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.431534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] PATH_INFO: `/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f/users/73691a344eef4191aadb2dd6f7a1278f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.433603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7fa189f2d7041f3b6237b5bad32d47f, user_id=73691a344eef4191aadb2dd6f7a1278f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.436256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.449080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1160/2289] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:43:55 2022] PUT /identity/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f/users/73691a344eef4191aadb2dd6f7a1278f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:43:55.461453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.461833 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.462183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.495990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] MFA Rules not processed for user `73691a344eef4191aadb2dd6f7a1278f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:55.497226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.582182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1130/2290] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:43:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:55.593546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.595391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:55.659296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec475b-49c5-44b9-9090-9a9ebb853be1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.663127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.663858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.664748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.665034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.675020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.676542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6172fc-fdc9-453d-84f3-08029b7c3658 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.687940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1161/2291] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:55.797765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:55.807805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f6abd-c24d-41c4-a160-0f323039f29c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:43:55.811476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:43:55.812138 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:55.812602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:55.812906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:55.825102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:43:55.879568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:43:55.881079 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:43:55.891766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1131/2292] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:43:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:43:59.744029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:43:59.744875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:43:59.744875 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:43:59.830405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:43:59.832411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:43:59.931033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1162/2293] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:43:59.978231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:43:59.980335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:00.108984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e428b-4375-4fd3-b567-8d228452985d service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:00.115615 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:00.116296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:00.116618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:00.116906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:00.128076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:00.129754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713719f-b83f-40d6-a2a1-83cf6c278169 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:00.140302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1132/2294] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:43:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:00.831166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:00.847873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:00.992502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4e757-46e3-455e-930e-eb69f0521800 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.005352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.007081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.008171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.008616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] PATH_INFO: `/v3/users/4e5b1d1bb5c04cdd8154996e0a6afa73` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.010994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5b1d1bb5c04cdd8154996e0a6afa73)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.023992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.114846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5b1d1bb5c04cdd8154996e0a6afa73'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:01.138815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5b1d1bb5c04cdd8154996e0a6afa73'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:01.153999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5b1d1bb5c04cdd8154996e0a6afa73'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:01.154971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5b1d1bb5c04cdd8154996e0a6afa73'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:01.155752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5b1d1bb5c04cdd8154996e0a6afa73'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:01.178965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1163/2295] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:00 2022] DELETE /identity/v3/users/4e5b1d1bb5c04cdd8154996e0a6afa73 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:01.186478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.187992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.188550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.218547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:01.221101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.385010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1133/2296] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:01.400009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:01.401566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:01.525314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b3c4-f162-463b-8351-784e19ab006b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:01.530133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:01.531431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:01.531726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:01.532001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:01.545046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:01.546537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:01.560173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1164/2297] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:02.127027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.130629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:02.164463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0bc18-3b52-41c2-b339-38aa9b2d5b8c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.176243 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.184081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.186868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.190235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] PATH_INFO: `/v3/projects/3912566f103f44a7a2f3008d8d456e0f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.193955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3912566f103f44a7a2f3008d8d456e0f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.199687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.249324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.321192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3912566f103f44a7a2f3008d8d456e0f', 'request_id': 'req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.329302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3912566f103f44a7a2f3008d8d456e0f', 'request_id': 'req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.356245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3912566f103f44a7a2f3008d8d456e0f', 'request_id': 'req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.376949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] The token cache is being invalidate because project 3912566f103f44a7a2f3008d8d456e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:02.377580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.378285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.383574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1134/2298] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:02 2022] DELETE /identity/v3/projects/3912566f103f44a7a2f3008d8d456e0f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:02.385709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:02.406169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce4fd-9c29-4bf7-8733-d7c4880af251 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:02.447941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:02.532540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:02.534016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:02.534605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:02.535071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] PATH_INFO: `/v3/users/73691a344eef4191aadb2dd6f7a1278f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:02.537211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73691a344eef4191aadb2dd6f7a1278f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:02.545915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:02.625793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73691a344eef4191aadb2dd6f7a1278f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.649236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73691a344eef4191aadb2dd6f7a1278f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.660194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73691a344eef4191aadb2dd6f7a1278f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.661123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73691a344eef4191aadb2dd6f7a1278f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.661832 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8cf6630e-5025-4ca6-bcac-61a53b3aa2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73691a344eef4191aadb2dd6f7a1278f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:02.706317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1165/2299] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:02 2022] DELETE /identity/v3/users/73691a344eef4191aadb2dd6f7a1278f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:03.348031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:03.353770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:03.393006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d78aa-0c67-4a5b-a2cf-9cb1d85bd1c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:03.621093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:03.623143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.624136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.624930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] PATH_INFO: `/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.627810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7fa189f2d7041f3b6237b5bad32d47f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:03.632438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:03.778259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7fa189f2d7041f3b6237b5bad32d47f', 'request_id': 'req-17644959-9b66-4611-9b2e-4ef0137b1ffa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.793423 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7fa189f2d7041f3b6237b5bad32d47f', 'request_id': 'req-17644959-9b66-4611-9b2e-4ef0137b1ffa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.816712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7fa189f2d7041f3b6237b5bad32d47f', 'request_id': 'req-17644959-9b66-4611-9b2e-4ef0137b1ffa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.853162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] The token cache is being invalidate because project d7fa189f2d7041f3b6237b5bad32d47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:03.854540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.855972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-17644959-9b66-4611-9b2e-4ef0137b1ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:03.876039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:03.877630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:03.878347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:03.883399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1135/2300] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:03 2022] DELETE /identity/v3/projects/d7fa189f2d7041f3b6237b5bad32d47f => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:03.934699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:03.938054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.099835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1166/2301] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:04.125814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.126776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.127456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.175542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.177222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:04.219884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1136/2302] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:04.227031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.243008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a2432-5962-409a-b545-efabdb80ea54 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.259470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.260824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.261341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.261898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.263201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:04.263711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.266093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.300417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1167/2303] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:04.307660 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.332464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500dc8f-28e7-40a5-a037-032b38c95bde None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.399442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.403796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.404572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.405463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.407743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.411781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.466449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1137/2304] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/projects => generated 374 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:04.476153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.488540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6c821-cf11-4b51-a20f-d8b69a9670fa admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.543186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.608287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.609873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.610167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.610448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.611165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.618198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.664401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1168/2305] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:04.664840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.680559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7ac1e3-5d5b-407d-b04e-2e77b0dab279 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.686025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.686908 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.687314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.687706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.688635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.690676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.694232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:04.709136 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1138/2306] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/roles => generated 1427 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:04.713395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.727526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52eb8f3-821a-4076-9097-e88e0c48f8d8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.734017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.735051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.735502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.735956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.736963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.738974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f61704-ba26-465c-a670-7e89d5db96d2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.758186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1169/2307] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:04 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:04.760115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:04.772283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26a01a-e34a-4503-9157-dd818d281396 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:04.778148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:04.779187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.779489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.779801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] PATH_INFO: `/v3/projects/7f79ffb1174f4871bd20506cc2ee0a0d/users/e9001d47669e4926b0505ed2ce0436ca/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.805276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f79ffb1174f4871bd20506cc2ee0a0d, user_id=e9001d47669e4926b0505ed2ce0436ca, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:04.808458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:04.844841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1139/2308] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:04 2022] PUT /identity/v3/projects/7f79ffb1174f4871bd20506cc2ee0a0d/users/e9001d47669e4926b0505ed2ce0436ca/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:04.846716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:04.847017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:04.847305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:04.883242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] MFA Rules not processed for user `e9001d47669e4926b0505ed2ce0436ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:04.884565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.080341 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1170/2309] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:05.111672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.115075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.191252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.194016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.301458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68601dce-c0e0-48d0-9da5-fff0f42a41d4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.335479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.356647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.362372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.363032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.444680 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.450778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.491663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1140/2310] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:05.518290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d254c4-4a15-4913-819e-c3e9b8018522 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.533931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:05.547827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.549027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.551905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.552449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.556924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.598466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.606604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd7b27-651e-4a10-b53d-da0a181c31c7 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.631416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1171/2311] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:05.682163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba524196-71fb-4166-bd86-6fc094bdba00 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:05.693678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:05.695577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.696096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.696638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] PATH_INFO: `/v3/users/e9001d47669e4926b0505ed2ce0436ca` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.699071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9001d47669e4926b0505ed2ce0436ca)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:05.703215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:05.788335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9001d47669e4926b0505ed2ce0436ca'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:05.789358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9001d47669e4926b0505ed2ce0436ca'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:05.804006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9001d47669e4926b0505ed2ce0436ca'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:05.816065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9001d47669e4926b0505ed2ce0436ca'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:05.823317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:05.829068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9001d47669e4926b0505ed2ce0436ca'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:05.840276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1141/2312] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:05 2022] DELETE /identity/v3/users/e9001d47669e4926b0505ed2ce0436ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:05.845614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:05.849133 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:05.850113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:05.890564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:05.893713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:05.905573 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:06.035944 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1172/2313] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:06.059784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.062429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.221007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2467bd-bc84-488e-bd93-c91dd7a1cd93 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:06.235339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:06.241364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:06.244925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:06.245622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:06.267860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:06.270096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42361138-59a2-46b4-b082-a4bf23665e2a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:06.288003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1142/2314] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:06.963231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:06.966557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:06.996296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8768-6715-4bda-86cb-ed3674cf00b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.003154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.007214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.007674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.008060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] PATH_INFO: `/v3/projects/7f79ffb1174f4871bd20506cc2ee0a0d` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.011719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f79ffb1174f4871bd20506cc2ee0a0d)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.016853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.144135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f79ffb1174f4871bd20506cc2ee0a0d', 'request_id': 'req-b3854f4d-d7fb-4154-a819-db82f7794338'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.160202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f79ffb1174f4871bd20506cc2ee0a0d', 'request_id': 'req-b3854f4d-d7fb-4154-a819-db82f7794338'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.171256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f79ffb1174f4871bd20506cc2ee0a0d', 'request_id': 'req-b3854f4d-d7fb-4154-a819-db82f7794338'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.188861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] The token cache is being invalidate because project 7f79ffb1174f4871bd20506cc2ee0a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:07.189140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.189890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3854f4d-d7fb-4154-a819-db82f7794338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:07.191599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1173/2315] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:06 2022] DELETE /identity/v3/projects/7f79ffb1174f4871bd20506cc2ee0a0d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:07.197788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.198565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.198565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.222231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.223472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.306722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1143/2316] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:07.320515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.320515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.320515 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.357777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:07.358965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:07.369926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1174/2317] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:07.373899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.404285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5329f0-91ab-4215-b81a-9fcdd3e745b9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.411102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.412157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.412611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.412779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.413528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:07.413921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.415665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.434535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1144/2318] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:07.437763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.459361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc59fb-2774-4faa-ba54-53d81486ede7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.470767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583580-9967-428f-8108-051013902802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.471475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583580-9967-428f-8108-051013902802 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.471920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583580-9967-428f-8108-051013902802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.472389 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd583580-9967-428f-8108-051013902802 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.473646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583580-9967-428f-8108-051013902802 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.476281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd583580-9967-428f-8108-051013902802 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.570860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1175/2319] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/projects => generated 374 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:07.573317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.586773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27447ae6-5c1a-492b-8821-4130038d91fd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.699498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.700363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.700688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.700976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.701685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.703816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.752631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1145/2320] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:07 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:07.754271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583580-9967-428f-8108-051013902802 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.780254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd583580-9967-428f-8108-051013902802 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.801304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.802234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.802644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.803511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.805178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.808284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.835080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1176/2321] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:07.841314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.862676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c90b54-070a-4f2e-9cf9-82c876a05763 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.878324 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.879297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.879693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.880091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:07.881139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:07.883901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e9c42-df6a-4d86-a6b4-aba584f2e150 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:07.926080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1146/2322] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:07 2022] GET /identity/v3/roles => generated 1427 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:07.931963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:07.965517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3b32e-9747-473d-8585-f230aee605a1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:07.974914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:07.977280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:07.977780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:07.978274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] PATH_INFO: `/v3/projects/6f26d3513fd546569b8344d4156644e2/users/68da17d149634e3ab06e75b1b169aafa/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.023516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f26d3513fd546569b8344d4156644e2, user_id=68da17d149634e3ab06e75b1b169aafa, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.034478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eff562-91be-413f-a468-f31a0a968afe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.082248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1177/2323] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:07 2022] PUT /identity/v3/projects/6f26d3513fd546569b8344d4156644e2/users/68da17d149634e3ab06e75b1b169aafa/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:08.085090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.086362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.086996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.103123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.132110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.132564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.132928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.154383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:08.157257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.191504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:08.198597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] MFA Rules not processed for user `68da17d149634e3ab06e75b1b169aafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:08.203078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.250988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1178/2324] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:08.285572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.287304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.337379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1147/2325] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:08.356065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:08.359107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:08.423657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cf0c1-367f-4143-a8e9-41e29e3801c8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.431372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.432072 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.432386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.432816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.443623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.446046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0dfed-97b3-4ddd-b9fe-58e3be57d3f9 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.456840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1179/2326] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:08.540541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09b7d6-f317-4754-b780-7cee70c4330f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:08.548294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:08.548882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:08.549253 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:08.549674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:08.569819 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:08.573156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:08.595331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1148/2327] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:09.805937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823f4-a529-408b-ad72-7bb9f9c1a340 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.807002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823f4-a529-408b-ad72-7bb9f9c1a340 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.807478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1823f4-a529-408b-ad72-7bb9f9c1a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.856772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4d1823f4-a529-408b-ad72-7bb9f9c1a340 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:09.859210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d1823f4-a529-408b-ad72-7bb9f9c1a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:09.871868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1180/2328] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:09.899890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:09.927172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f8a5-b147-4456-bda8-c624aa8b1763 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:09.936749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:09.937843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:09.938508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:09.938942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:09.956237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:09.959556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:09.979252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1149/2329] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 16:44:10.415323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53505-c5b5-4e31-be28-2e3b92363541 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.416163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53505-c5b5-4e31-be28-2e3b92363541 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.417033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53505-c5b5-4e31-be28-2e3b92363541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.440407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7dc53505-c5b5-4e31-be28-2e3b92363541 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:10.442715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7dc53505-c5b5-4e31-be28-2e3b92363541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:10.464345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1181/2330] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:10.501440 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:10.526497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0cefe-4340-4252-b162-c804994d3642 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:10.552943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:10.554487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:10.555264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:10.555952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:10.572472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:10.574806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:10.586043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1150/2331] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:11.206086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.206891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.206891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.228891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:11.230098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:11.240315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1182/2332] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:11.268351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:11.292525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1f737-530e-4e22-a2c4-32a1f03d21ab service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:11.302353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:11.304037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:11.305190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:11.306033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:11.325124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:11.328952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0af3a-769b-4b9b-8717-3b051543686c service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:11.346792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1151/2333] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:14.041866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.130073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ee9e3-629c-474e-9431-d54005cee1b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.135748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.136593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.136877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.137152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] PATH_INFO: `/v3/users/68da17d149634e3ab06e75b1b169aafa` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.138372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68da17d149634e3ab06e75b1b169aafa)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.140462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.193131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.196441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68da17d149634e3ab06e75b1b169aafa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.216932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68da17d149634e3ab06e75b1b169aafa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.227717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68da17d149634e3ab06e75b1b169aafa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.228519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68da17d149634e3ab06e75b1b169aafa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.229145 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68da17d149634e3ab06e75b1b169aafa'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.245812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1183/2334] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:14 2022] DELETE /identity/v3/users/68da17d149634e3ab06e75b1b169aafa => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:14.251862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.252570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.253091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.299224 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.303684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.308338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:14.318065 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.412639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:14.453830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1152/2335] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:14.470830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.473945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.542096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8621fc85-5b18-4877-aff4-942b5ca4b8b4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.552161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.553869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.555186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.555726 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] PATH_INFO: `/v3/users/6f67b0bec1d74cf1a07415665e782d2e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.559282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f67b0bec1d74cf1a07415665e782d2e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.564442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.627043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415ae3-0f8a-40e0-bbf7-ea2031f662aa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:14.634766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:14.636410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.637150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.637924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.659461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:14.662051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e0496-bedb-4a73-8718-0bc3f4b90acb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:14.673867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f67b0bec1d74cf1a07415665e782d2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.676353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1153/2336] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:44:14.720801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f67b0bec1d74cf1a07415665e782d2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.735348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f67b0bec1d74cf1a07415665e782d2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.736308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f67b0bec1d74cf1a07415665e782d2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.737064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f67b0bec1d74cf1a07415665e782d2e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:14.760466 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1184/2337] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:14 2022] DELETE /identity/v3/users/6f67b0bec1d74cf1a07415665e782d2e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:14.763893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:14.764190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:14.764544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:14.792855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:14.794563 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:14.895254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1154/2338] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:14.926002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:14.930931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.083973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.124705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1d5413-de17-4f09-a0e1-0534f88e4a1a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.134522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.135950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.137578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.138413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.160625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.164522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.188685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1185/2339] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:15.306175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.309504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.351929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acb60a-4890-4e21-89b2-cea08341ab14 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.361831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.363561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.364164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.364883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] PATH_INFO: `/v3/projects/6f26d3513fd546569b8344d4156644e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.368953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f26d3513fd546569b8344d4156644e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.372457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.483704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f26d3513fd546569b8344d4156644e2', 'request_id': 'req-3e8db858-afdb-4c11-8c72-364b9916d7d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.493584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f26d3513fd546569b8344d4156644e2', 'request_id': 'req-3e8db858-afdb-4c11-8c72-364b9916d7d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.510049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f26d3513fd546569b8344d4156644e2', 'request_id': 'req-3e8db858-afdb-4c11-8c72-364b9916d7d9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.522080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.525222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.553351 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] The token cache is being invalidate because project 6f26d3513fd546569b8344d4156644e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:15.553923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.555931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3e8db858-afdb-4c11-8c72-364b9916d7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.564883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1155/2340] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:15 2022] DELETE /identity/v3/projects/6f26d3513fd546569b8344d4156644e2 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:15.565177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aaeae4-91f5-4126-8323-372bcf06e8e8 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.573433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047cb7-2bb1-488e-b9dd-d40eb2082587 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.573888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047cb7-2bb1-488e-b9dd-d40eb2082587 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.574056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81047cb7-2bb1-488e-b9dd-d40eb2082587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.618934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81047cb7-2bb1-488e-b9dd-d40eb2082587 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.620184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81047cb7-2bb1-488e-b9dd-d40eb2082587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.658366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:15.696079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.697334 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.697658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.697826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] PATH_INFO: `/v3/projects/2b4d322cc014464da21503514cd08b91` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.699641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4d322cc014464da21503514cd08b91)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:15.701966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:15.801473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1156/2341] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:15.805793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4d322cc014464da21503514cd08b91', 'request_id': 'req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.814538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.814890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.815114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.824739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4d322cc014464da21503514cd08b91', 'request_id': 'req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.835007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4d322cc014464da21503514cd08b91', 'request_id': 'req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.841305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.842762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.850616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] The token cache is being invalidate because project 2b4d322cc014464da21503514cd08b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:15.851293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.852143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6db16c14-f3fc-4bd0-b06e-cf61bc301e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:15.854316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1186/2342] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:15 2022] DELETE /identity/v3/projects/2b4d322cc014464da21503514cd08b91 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:15.860512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374b65-3468-4c0e-8541-0018b125415e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.860985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374b65-3468-4c0e-8541-0018b125415e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.861171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb374b65-3468-4c0e-8541-0018b125415e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.888346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fb374b65-3468-4c0e-8541-0018b125415e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:15.889594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fb374b65-3468-4c0e-8541-0018b125415e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:15.970572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1157/2343] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:15.978105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:15.990902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502a71e-cf9f-4bc4-b114-5a835e111b68 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:15.997247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:15.998613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:15.999077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:15.999508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:15.999930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1187/2344] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:16.001356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:16.001686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.003780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.010033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.010330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.010667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.035575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1158/2345] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:44:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:16.038049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.053626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:16.055159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.056493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0130b-4377-419c-ab70-47c00211d3f8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.065843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.067711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.067941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1188/2346] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:16.072627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.073008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.073785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.075365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.075797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.095787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089321c-7e1a-4d31-9ed7-351900c9ef7c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.101719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.102511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.102873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.103226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.104149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:16.104578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.106570 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.116019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.124586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1189/2347] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:16.131681 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.144299 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874c983-34ba-487f-a567-cf3abac77536 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.151759 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.152827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.152957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.153337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.154146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.156418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.177292 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1159/2348] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/projects => generated 370 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:16.182378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.204200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1190/2349] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/projects => generated 384 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:16.205873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.311607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978d6aa-dcab-4e18-82bb-3504dd3533d2 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.325022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.326706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.327474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.329569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.331599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.335451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.338791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db8cff-6b0f-402d-9500-0927507ded39 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.347076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.348961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.349133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.349572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.350928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.355398 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.382901 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1191/2350] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:16.384706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.397386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1160/2351] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:16.400746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.406996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01ec19-a28b-4b5c-a40f-7ed97ab9a079 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.413829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.414696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.415068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.415507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.416360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.418149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.418894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438ad48-1be4-4867-aaaa-cca03113f7d0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.426573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.427629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.428205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.428685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.430789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.433744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.438690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1192/2352] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:16.444904 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.454545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1161/2353] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:16.458189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c00ff6-b36b-4825-956d-30c7cdbd9103 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.460008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.463697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.464518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.464889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.465235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.467406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.468177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.477760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3a50-30c5-49d9-be84-6cadfabd29ea admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.485976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.486864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.487478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.487946 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.489083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.491170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.495309 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1193/2354] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles => generated 1427 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:44:16.495517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.499491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.520305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1162/2355] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/roles => generated 1427 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:16.521879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1d626-1595-4cf6-b537-8428c2a74237 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.523504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.531491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.534926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.535635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.536275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] PATH_INFO: `/v3/projects/7fa63b33258040739dd6367d959c2250/users/bb976c109cca488aa7317c71b54e5002/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.540648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309ecd8-2a8c-4955-9c87-5474f0e6a53c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.546871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.548601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.548601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.548601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] PATH_INFO: `/v3/projects/6580c9fd0e7b4c01bcd73806d2b63aa1/users/03636a7f98f245dd98b5206dea27b42a/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.575651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6580c9fd0e7b4c01bcd73806d2b63aa1, user_id=03636a7f98f245dd98b5206dea27b42a, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.580094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a4ab8-c486-413c-837e-a28137d9d571 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.581674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa63b33258040739dd6367d959c2250, user_id=bb976c109cca488aa7317c71b54e5002, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:16.586186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520dbc3-e0e1-4200-9756-9b18b1e5d77f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:16.617468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1163/2356] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:16 2022] PUT /identity/v3/projects/6580c9fd0e7b4c01bcd73806d2b63aa1/users/03636a7f98f245dd98b5206dea27b42a/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:16.619295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.619803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.623590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1194/2357] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:16 2022] PUT /identity/v3/projects/7fa63b33258040739dd6367d959c2250/users/bb976c109cca488aa7317c71b54e5002/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:16.623838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.627065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.627453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.627866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.661450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] MFA Rules not processed for user `03636a7f98f245dd98b5206dea27b42a`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:16.664186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:16.664796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.665548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.798993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1164/2358] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:16.821800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1195/2359] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:16.822075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.823657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.836518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:16.838751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:16.871615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:16.978222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3851ab-7063-4fc9-8bc8-6ac96a189187 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:16.985354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:16.986514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:16.987026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:16.987526 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:16.997326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3623bde-f74b-4dfa-8698-fdb5cb1b33bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:17.001778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.005895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2234bc-5e9f-4258-86b5-24a89cde0e9f service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.006172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:17.006725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:17.007011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:17.007805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:17.027435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:17.027720 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a17054-d0b7-4d87-b3c3-6b7a356e7c9e service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:17.047835 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1196/2360] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:17.053229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1165/2361] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:21.515514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:21.516142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:21.516142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:21.554618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] MFA Rules not processed for user `9330e65e73394f18b87c5b1d5d47f564`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:21.556949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:21.686247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1197/2362] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:24.643624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c01ce-f01f-4e8d-ab35-78095fae54c4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:24.649484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c01ce-f01f-4e8d-ab35-78095fae54c4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:24.650000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c01ce-f01f-4e8d-ab35-78095fae54c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:24.685511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b82c01ce-f01f-4e8d-ab35-78095fae54c4 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:24.687482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b82c01ce-f01f-4e8d-ab35-78095fae54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:24.766711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:24.810465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1166/2363] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:44:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:24.829109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:24.831401 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:25.070809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90cd31-2e16-417b-af21-658e748c8f29 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:25.083250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:25.084797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:25.086248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:25.086772 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:25.105592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:25.109308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:25.140238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1198/2364] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:27.073550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.075063 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.075710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.129848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] MFA Rules not processed for user `bb976c109cca488aa7317c71b54e5002`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:27.131596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:27.282977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1167/2365] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:27.288841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.337347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35950df9-9f59-48e4-b47c-4a33ad1fc29c service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.345033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.346181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.346694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.347333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.348241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.351451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.410550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1199/2366] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:27 2022] POST /identity/v3/projects => generated 384 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:27.415850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.436798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13948f26-c2e0-4193-8f65-aba5db9a5adb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.536817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.537889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.538855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.544220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.545320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.547531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.591780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1168/2367] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:27 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:27.596720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.615060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaf83c-3338-4d9c-a0e8-dbb48feb4652 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.621165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.622422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.622706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.623194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.624315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.627250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.644085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1200/2368] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:27 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:27.650394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.662847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6d1f3-597c-4251-9f7e-ab694c8ff463 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.670655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.671741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.672155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.672581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] PATH_INFO: `/v3/projects/14f0553c5f8445d48ec0e97094ba4618/users/9611d2b4830c45e6bedac28b8164b7df/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.691469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f0553c5f8445d48ec0e97094ba4618, user_id=9611d2b4830c45e6bedac28b8164b7df, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.695246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.718830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.719445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1169/2369] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:27 2022] PUT /identity/v3/projects/14f0553c5f8445d48ec0e97094ba4618/users/9611d2b4830c45e6bedac28b8164b7df/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:27.732801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79e3bb-4d75-4031-a0fc-6e41fc756369 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.761267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:27.857264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.858533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.859278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.859883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.862053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.865633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.892161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:27.895425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1201/2370] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:27 2022] GET /identity/v3/roles => generated 1427 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:27.910249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0dc7-c695-4310-b8da-73be2ff4a0cc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:27.929805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:27.937049 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:27.937415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:27.937770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] PATH_INFO: `/v3/projects/14f0553c5f8445d48ec0e97094ba4618/users/9611d2b4830c45e6bedac28b8164b7df/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:27.940269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14f0553c5f8445d48ec0e97094ba4618, user_id=9611d2b4830c45e6bedac28b8164b7df, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:27.943589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:27.962921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1170/2371] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:27 2022] PUT /identity/v3/projects/14f0553c5f8445d48ec0e97094ba4618/users/9611d2b4830c45e6bedac28b8164b7df/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:28.014788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:28.017363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:28.052614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f53d0e-6419-4c58-b895-46e53266a965 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:28.173923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:28.179052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:28.179345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:28.179630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] PATH_INFO: `/v3/users/9c0fb73a262843f89285a6e161a1abed` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:28.181195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0fb73a262843f89285a6e161a1abed)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:28.183736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:28.291594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0fb73a262843f89285a6e161a1abed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:28.367945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0fb73a262843f89285a6e161a1abed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:28.394988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0fb73a262843f89285a6e161a1abed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:28.396540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0fb73a262843f89285a6e161a1abed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:28.397987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-09301259-f9ec-4cd6-96cf-78fcf1868367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0fb73a262843f89285a6e161a1abed'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:28.443424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1202/2372] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:44:28 2022] DELETE /identity/v3/users/9c0fb73a262843f89285a6e161a1abed => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:28.798531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:28.801133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:28.816648 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993b185-db7d-49ca-b092-315e6ae70954 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:28.854488 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:28.951447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:28.955708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:28.956196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:28.957933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] PATH_INFO: `/v3/projects/9f81bd02cdf94ff98c1e9534199b425c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:28.960897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f81bd02cdf94ff98c1e9534199b425c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:28.968018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.045229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f81bd02cdf94ff98c1e9534199b425c', 'request_id': 'req-ce0fabd2-361d-4917-919d-f432e57f2a4d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:29.052545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f81bd02cdf94ff98c1e9534199b425c', 'request_id': 'req-ce0fabd2-361d-4917-919d-f432e57f2a4d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:29.064923 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f81bd02cdf94ff98c1e9534199b425c', 'request_id': 'req-ce0fabd2-361d-4917-919d-f432e57f2a4d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:29.084001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] The token cache is being invalidate because project 9f81bd02cdf94ff98c1e9534199b425c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:44:29.084325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:29.085044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce0fabd2-361d-4917-919d-f432e57f2a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:44:29.087638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1171/2373] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:44:28 2022] DELETE /identity/v3/projects/9f81bd02cdf94ff98c1e9534199b425c => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:29.093782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.094122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.094425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.123695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:29.125937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:29.197036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:29.263675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1203/2374] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:44:29.272003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586abe65-a903-4014-90e0-ab267b298197 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.272350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586abe65-a903-4014-90e0-ab267b298197 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.273120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586abe65-a903-4014-90e0-ab267b298197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.295585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-586abe65-a903-4014-90e0-ab267b298197 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:29.296841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-586abe65-a903-4014-90e0-ab267b298197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:29.320657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.326199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1172/2375] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:29.331931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b81fc6-d077-48bb-9f2d-8b17c6e95103 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.338580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.339271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.339563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.339847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.340632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:44:29.340942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.342579 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.361981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586abe65-a903-4014-90e0-ab267b298197 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.372159 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586abe65-a903-4014-90e0-ab267b298197 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.373191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1204/2376] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:44:29 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:44:29.377925 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.379327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.379327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.379745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.381059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.383632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.432672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.442267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1173/2377] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:29 2022] POST /identity/v3/projects => generated 374 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:44:29.454940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d47a6-56c2-4fe2-9482-c68cb5f94f82 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.596438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.597910 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.598616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.600602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.606144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.614959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.684977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1205/2378] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:29 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:29.693354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.721731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f1195-a5f0-49ac-a0ae-a61ddcdf8eb1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.731795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.733322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.733322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.733322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.735733 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.740068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.779580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1174/2379] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:29 2022] GET /identity/v3/roles => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:29.789894 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.879902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780d58b-a479-4b6a-98d0-0992f07839a8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.907547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:29.909388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:29.910059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:29.910494 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:29.918873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:29.919698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af834970-4d93-43b5-9416-3a1149a78583 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:29.948479 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1206/2380] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:29 2022] GET /identity/v3/roles => generated 1427 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:29.952343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:29.984460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0586eb7-6f6d-4808-9d89-bd7bd35e0b64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:29.998624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:30.000912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:30.001343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:30.001765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] PATH_INFO: `/v3/projects/a5ffc538830947bbbfd272fb857cbc03/users/c2f7cb90a5d74658ac55943d37d28737/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:30.031545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ffc538830947bbbfd272fb857cbc03, user_id=c2f7cb90a5d74658ac55943d37d28737, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:30.045673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:30.080034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1175/2381] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:29 2022] PUT /identity/v3/projects/a5ffc538830947bbbfd272fb857cbc03/users/c2f7cb90a5d74658ac55943d37d28737/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:30.082814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f867f-01e9-4096-84a2-ace422c12508 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:30.083260 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f867f-01e9-4096-84a2-ace422c12508 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:30.083699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f867f-01e9-4096-84a2-ace422c12508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:30.134527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b95f867f-01e9-4096-84a2-ace422c12508 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:30.138628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b95f867f-01e9-4096-84a2-ace422c12508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:30.347506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1207/2382] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:30.378212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:30.381203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:30.497764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216b7e-2d8d-4eb2-b94a-b9640d935d0e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:30.505046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:30.506560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:30.507370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:30.508094 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:30.533702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:30.535681 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:30.552300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:30.574585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1176/2383] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:37.615926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e8d19-2e07-4d4e-9c1a-bd27dc6b36f6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:37.618625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e8d19-2e07-4d4e-9c1a-bd27dc6b36f6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:37.619107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e8d19-2e07-4d4e-9c1a-bd27dc6b36f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:37.704044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9f4e8d19-2e07-4d4e-9c1a-bd27dc6b36f6 None None] MFA Rules not processed for user `9611d2b4830c45e6bedac28b8164b7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:37.706977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9f4e8d19-2e07-4d4e-9c1a-bd27dc6b36f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:37.789102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:37.898218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1208/2384] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:37.917567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:37.919380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.019865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96799079-341e-4d04-a494-f00bf60c1250 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.026287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498641-2215-4696-b886-771cadc88625 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.026976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498641-2215-4696-b886-771cadc88625 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.027263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498641-2215-4696-b886-771cadc88625 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.027540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498641-2215-4696-b886-771cadc88625 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.030339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a498641-2215-4696-b886-771cadc88625 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.123304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498641-2215-4696-b886-771cadc88625 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.125569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a498641-2215-4696-b886-771cadc88625 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.148426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1177/2385] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:38.322392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4df3f-1ccd-46dc-913e-e3a7bcde5d73 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.322903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4df3f-1ccd-46dc-913e-e3a7bcde5d73 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.323376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4df3f-1ccd-46dc-913e-e3a7bcde5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.396955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-10d4df3f-1ccd-46dc-913e-e3a7bcde5d73 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:38.401826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-10d4df3f-1ccd-46dc-913e-e3a7bcde5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.527266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1209/2386] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:38.556573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498641-2215-4696-b886-771cadc88625 service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:38.566188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8a498641-2215-4696-b886-771cadc88625 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:38.739694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498641-2215-4696-b886-771cadc88625 service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:38.749703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:38.750118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:38.750410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:38.750698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:38.764462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:38.766016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:38.778263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1178/2387] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:44:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:44:40.483106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807b542-73a5-45d8-a682-386f636d729b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.485243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807b542-73a5-45d8-a682-386f636d729b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.486097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807b542-73a5-45d8-a682-386f636d729b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.540833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0807b542-73a5-45d8-a682-386f636d729b None None] MFA Rules not processed for user `c2f7cb90a5d74658ac55943d37d28737`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:40.543348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0807b542-73a5-45d8-a682-386f636d729b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:40.733904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:40.735183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1210/2388] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:40.749371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c106a-04ce-43c3-bd82-c5f3cc6e6590 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:40.778050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:40.778743 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:40.779038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:40.779316 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:40.780045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:40.782173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:40.890905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1179/2389] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/projects => generated 372 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:40.896251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807b542-73a5-45d8-a682-386f636d729b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:40.958728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807b542-73a5-45d8-a682-386f636d729b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.199552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.201209 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.208938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.210785 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.213729 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.225918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.262967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.308477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1211/2390] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:44:40 2022] POST /identity/v3/users => generated 293 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:44:41.308830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.331323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67f497-1ca9-457c-acff-930c0db83e77 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.373299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.374787 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.375339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.375851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.377062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.381937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.438029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1180/2391] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:41.442765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.484887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9cc1c-7f5c-46c2-88ea-8d3cdc64939e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.504671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.505913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.506117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.506411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] PATH_INFO: `/v3/projects/4a57463b71824127bb0c2438ee4a66cc/users/30dd60de0bf7444b998dde5bb6f74bbf/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.567486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a57463b71824127bb0c2438ee4a66cc, user_id=30dd60de0bf7444b998dde5bb6f74bbf, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.571236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.612321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.621262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1212/2392] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:41 2022] PUT /identity/v3/projects/4a57463b71824127bb0c2438ee4a66cc/users/30dd60de0bf7444b998dde5bb6f74bbf/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:44:41.628792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef8d1-ef07-4caf-a830-0856c7022c5c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.663610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:41.750070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.751595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.752224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.752692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.753636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.755601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d60be-e119-428d-a911-c94a39401230 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.773262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:41.784224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1181/2393] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:44:41 2022] GET /identity/v3/roles => generated 1427 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:44:41.785558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2981066-a4f4-42d9-9c41-9128f54a914b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:41.791714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:41.793070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:41.794160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:41.794160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] PATH_INFO: `/v3/projects/4a57463b71824127bb0c2438ee4a66cc/users/30dd60de0bf7444b998dde5bb6f74bbf/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:41.796545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a57463b71824127bb0c2438ee4a66cc, user_id=30dd60de0bf7444b998dde5bb6f74bbf, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:41.799707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:41.813680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1213/2394] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:44:41 2022] PUT /identity/v3/projects/4a57463b71824127bb0c2438ee4a66cc/users/30dd60de0bf7444b998dde5bb6f74bbf/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:44:51.763340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=24 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:51.811388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=3,keystone:SELECT=17 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:44:52.482027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57f0d-616d-4d4e-92eb-e31e8391e9bc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:52.483067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57f0d-616d-4d4e-92eb-e31e8391e9bc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:52.483588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57f0d-616d-4d4e-92eb-e31e8391e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:52.525025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-afd57f0d-616d-4d4e-92eb-e31e8391e9bc None None] MFA Rules not processed for user `30dd60de0bf7444b998dde5bb6f74bbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:52.526587 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-afd57f0d-616d-4d4e-92eb-e31e8391e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:52.679193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1182/2395] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:52.698117 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:44:52.700353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:52.985678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e437-92e2-4d23-b032-5eff030f293c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:44:53.000153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:44:53.001542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:53.002914 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:53.003313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:53.138055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:44:53.141272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069fc17f-1351-4e04-a9ca-22671e59bc3e service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:44:53.168775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1214/2396] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:44:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:44:55.249302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6effd8-4f28-46f7-9269-7bdd3de1678f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:55.249945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6effd8-4f28-46f7-9269-7bdd3de1678f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:55.250252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6effd8-4f28-46f7-9269-7bdd3de1678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:55.289424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7d6effd8-4f28-46f7-9269-7bdd3de1678f None None] MFA Rules not processed for user `c2f7cb90a5d74658ac55943d37d28737`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:55.291979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d6effd8-4f28-46f7-9269-7bdd3de1678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:55.316771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1183/2397] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:44:58.580744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:44:58.581974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:44:58.582262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:44:58.602648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] MFA Rules not processed for user `bb976c109cca488aa7317c71b54e5002`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:44:58.604847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:44:58.692505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1215/2398] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:44:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:01.597637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:01.597637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:01.597637 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:01.630167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:01.640221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:01.780494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1184/2399] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:45:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:45:01.809411 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:01.843735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:01.889903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b2383-bcc4-498d-bc3d-8ef77cc67637 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:01.897160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:01.897828 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:01.898124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:01.898404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:01.910414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:01.912010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba687c-4c95-45e2-923f-4f10c82d7f21 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:01.923266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1216/2400] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:45:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:45:11.761162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=62 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:11.920801 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=22 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:26.867645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:26.869475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:26.992756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9625e8-cf59-4651-9f67-ad1b35420efb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:26.998452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:26.999390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:26.999784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:27.000266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] PATH_INFO: `/v3/users/03636a7f98f245dd98b5206dea27b42a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:27.008705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03636a7f98f245dd98b5206dea27b42a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:27.008705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:27.060038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03636a7f98f245dd98b5206dea27b42a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.061344 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03636a7f98f245dd98b5206dea27b42a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.084981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03636a7f98f245dd98b5206dea27b42a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.096939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03636a7f98f245dd98b5206dea27b42a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.109623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03636a7f98f245dd98b5206dea27b42a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.116867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1185/2401] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:45:26 2022] DELETE /identity/v3/users/03636a7f98f245dd98b5206dea27b42a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:45:27.122246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939d34-1337-4178-9602-77f90b4554af None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:27.123164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939d34-1337-4178-9602-77f90b4554af None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:27.123164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9939d34-1337-4178-9602-77f90b4554af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:27.143069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e9939d34-1337-4178-9602-77f90b4554af None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:45:27.144319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9939d34-1337-4178-9602-77f90b4554af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:27.221417 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1217/2402] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:45:27.231871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:27.233576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:27.320607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becfb7-7137-4593-97e6-bea335ee5a95 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:27.324877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:27.325677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:27.326071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:27.326453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:27.337973 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:27.339537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:27.351818 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1186/2403] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:45:27.731605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939d34-1337-4178-9602-77f90b4554af None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:27.733597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e9939d34-1337-4178-9602-77f90b4554af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:27.747692 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9939d34-1337-4178-9602-77f90b4554af None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:27.752899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:27.753966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:27.754263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:27.754612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] PATH_INFO: `/v3/projects/6580c9fd0e7b4c01bcd73806d2b63aa1` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:27.756231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6580c9fd0e7b4c01bcd73806d2b63aa1)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:27.758447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:27.830952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6580c9fd0e7b4c01bcd73806d2b63aa1', 'request_id': 'req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.843611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6580c9fd0e7b4c01bcd73806d2b63aa1', 'request_id': 'req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.853405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6580c9fd0e7b4c01bcd73806d2b63aa1', 'request_id': 'req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.871245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] The token cache is being invalidate because project 6580c9fd0e7b4c01bcd73806d2b63aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:45:27.871735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.872831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:45:27.875548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1218/2404] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:45:27 2022] DELETE /identity/v3/projects/6580c9fd0e7b4c01bcd73806d2b63aa1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:45:37.346020 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:37.866257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:46.910276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:46.920649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3fa16f-b613-4551-89c9-d6dc0f907e8b service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:46.980185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:46.980747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:46.981034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:46.981313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:46.983467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:47.053644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:47.055101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:47.065730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1187/2405] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:45:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:49.700661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:45:49.705228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:49.727450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0086ef-9bf8-4a92-af6b-1df810ee2b27 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:45:49.735317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:45:49.736118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:45:49.736435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:45:49.736723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:45:49.740009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:45:49.848250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:45:49.850872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:45:49.863611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1219/2406] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:45:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:45:57.061276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=50 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:45:59.859194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=30 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:01.174388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:01.183808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbff23-f77a-4a54-9f9a-28ecd823e331 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:01.187489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:01.188133 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:01.188524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:01.188849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:01.190664 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:01.263909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:01.265381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:01.276779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1188/2407] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:01.507031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:01.519457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d26cf3-f87f-40df-abdb-3048cd77de86 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:01.524519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:01.524678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:01.524900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:01.525387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:01.527264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:01.541143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:01.542574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:01.553461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1220/2408] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:09.723778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:09.725235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:09.737461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:09.740485 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:09.757223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e0b30-d0bb-48a3-aac5-a2576d17c623 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:09.762822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:09.763481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:09.763769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:09.764087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:09.766042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:09.791820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db99741-b8b0-4be8-9908-44b51d0d6b44 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:09.797158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:09.797831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:09.798119 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:09.798397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:09.800297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:09.834469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:09.836263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ddc03-de40-41b1-a234-9a4399cde4e2 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:09.847710 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1221/2409] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:46:09.867090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:09.869936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:09.878983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1189/2410] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:10.140594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:10.141028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:10.141323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:10.159053 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:10.160274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:10.219459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1222/2411] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:46:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:10.261873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:10.263373 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:10.306184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:10.334516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7975c-7960-4403-b537-2f5cf232262d service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:10.339671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:10.340320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:10.340644 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:10.340926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:10.350264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:10.351867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:10.359975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1190/2412] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:46:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:46:20.211372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=59 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:20.356731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=14 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:21.822819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:21.824350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:21.836866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d9e7-df4c-4e71-a66a-f11037782060 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:21.840933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:21.841638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:21.841862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:21.842139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:21.844301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:21.861603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:21.863004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7ac14-9d81-45f5-b73a-5224b31c1d06 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:21.871911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1223/2413] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:26.167175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.177592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5926f9c0-c564-4bd4-9fc4-b466164cde0b service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.181236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.181870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.182158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.182459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.184262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.194244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.195920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83900561-79d2-4d12-9432-4d1f97f97415 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.203847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1191/2414] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:26.312874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7825-a019-42c9-a985-6ab7088c772b None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.313419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7825-a019-42c9-a985-6ab7088c772b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.313419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c7825-a019-42c9-a985-6ab7088c772b None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.314822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1224/2415] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:46:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:46:26.322306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d559-38ac-4b77-8444-40d54a6119a0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.322608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d559-38ac-4b77-8444-40d54a6119a0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.322897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2d559-38ac-4b77-8444-40d54a6119a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.362616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dba2d559-38ac-4b77-8444-40d54a6119a0 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:26.363841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dba2d559-38ac-4b77-8444-40d54a6119a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.374924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1192/2416] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:26.387319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7825-a019-42c9-a985-6ab7088c772b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.398620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c7825-a019-42c9-a985-6ab7088c772b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.402555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.403292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.403654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.404006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.414970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.416437 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47842cfe-2fac-4299-ab22-c112b9923edb service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.428290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1225/2417] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:26.497535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd5274-97a6-467f-bb4f-06043d49ddcc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.497829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd5274-97a6-467f-bb4f-06043d49ddcc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.498110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd5274-97a6-467f-bb4f-06043d49ddcc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.499574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1193/2418] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:46:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:46:26.504194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee56-5972-4f5c-bfc1-63f98f7f32a6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.504530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee56-5972-4f5c-bfc1-63f98f7f32a6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.504823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5cee56-5972-4f5c-bfc1-63f98f7f32a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.532193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1f5cee56-5972-4f5c-bfc1-63f98f7f32a6 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:26.533425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1f5cee56-5972-4f5c-bfc1-63f98f7f32a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.541131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1226/2419] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:26.552894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd5274-97a6-467f-bb4f-06043d49ddcc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.564817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd5274-97a6-467f-bb4f-06043d49ddcc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.567534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.568158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.568482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.568764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.576024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.577485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe8af2-d859-4bf9-a0f1-d106ba299b1b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.585581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1194/2420] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:26.672308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df52d-9929-432d-a5b9-20f8a241c6b0 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.672637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df52d-9929-432d-a5b9-20f8a241c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.672966 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2df52d-9929-432d-a5b9-20f8a241c6b0 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.674379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1227/2421] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:46:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:46:26.679746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.680101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.680485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.698666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:26.699922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.709756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1195/2422] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:46:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:26.720261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df52d-9929-432d-a5b9-20f8a241c6b0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.733258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2df52d-9929-432d-a5b9-20f8a241c6b0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.736893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.737539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.737827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.738108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.748288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.749749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb8048-f072-4efb-9863-54f2e4a4eacd service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.760310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1228/2423] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:46:26.824060 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:26.825549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.892381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cacc8e-affb-4956-b19d-ffa3d4a41ec2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:26.898029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:26.898669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:26.898958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:26.899238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:26.901071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:26.912131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:26.913739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:26.923519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1196/2424] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:29.756986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:29.757595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:29.757816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:29.780385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:46:29.781701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:29.791201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1229/2425] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:46:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:46:29.803771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:29.815210 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580632a-a6f0-4231-94be-01c773e268d5 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:29.822161 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:29.822821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:29.823109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:29.823401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:29.832716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:29.834879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:29.843920 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1197/2426] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:46:39.774877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=24 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:39.840448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=62 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:46:52.891315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:52.904819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b5c5e-5d79-4013-9aaf-7d2746a9b175 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:52.912272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:52.912809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:52.913098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:52.913378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:52.915388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:52.975269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:52.976883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac7768-d1e8-4a1d-bdbd-e8352186ec16 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:52.986182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1230/2427] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:46:57.775188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:46:57.788461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b779114-8fbd-4b85-afb6-610ed9108535 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:46:57.794271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:46:57.794929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:46:57.795219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:46:57.795505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:46:57.797374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:46:57.810103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:46:57.812179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:46:57.824219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1198/2428] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:46:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:01.055548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872b001-8ee3-45b5-888c-45b628260068 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.056115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872b001-8ee3-45b5-888c-45b628260068 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.056115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872b001-8ee3-45b5-888c-45b628260068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.077333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0872b001-8ee3-45b5-888c-45b628260068 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:01.078561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0872b001-8ee3-45b5-888c-45b628260068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:01.087450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1231/2429] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:47:01.101560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:01.114386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e6aee-aa05-4e4b-860e-5275e565afd0 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:01.121001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:01.121724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:01.121955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:01.122445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:01.132585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:01.134215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:01.145805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1199/2430] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:47:11.071783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=31 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:11.141311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=12 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:25.359647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:25.360247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:25.360247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:25.378708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] MFA Rules not processed for user `9330e65e73394f18b87c5b1d5d47f564`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:47:25.379936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:25.386907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1232/2431] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:47:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:47:31.559706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:31.561293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:31.580076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435ec7b-4ac3-4bd5-a9dc-2bf61646c3e5 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:31.587460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:31.588358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:31.588514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:31.588950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:31.590861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:31.605334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:31.607958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:31.620508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1200/2432] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:47:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:35.373781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:41.615878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:47:44.930303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:47:44.943771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06061048-8aa4-41e0-8cc7-9374cd026640 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:47:44.949616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:47:44.950278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:47:44.950634 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:47:44.950836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:47:44.952707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:47:45.023218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:47:45.024883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec42293-782b-4ee5-b4be-52718a41d10c service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:47:45.034608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1233/2433] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:47:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:47:55.030105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=28 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:26.489974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:48:26.505622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419ebac-a838-45c1-b60c-39e176e5d8c8 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:48:26.515821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:48:26.516840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:26.517502 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:26.518140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:26.521602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:26.546718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:48:26.550571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:48:26.569111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1201/2434] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:48:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:48:30.378113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:48:30.379126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:48:30.379650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:48:30.404749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] MFA Rules not processed for user `e4941664ae624d4190ff53e5965db33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:48:30.406887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:48:30.420012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1234/2435] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:48:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:48:36.561438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:48:40.396968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:10.714068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:10.716573 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:10.732434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e881e8-2fb6-4f33-9ca4-a5affb259517 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:10.738297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:10.739271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:10.739740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:10.740186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:10.742381 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:10.755616 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:10.757604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa01ee2-1edb-4248-99f3-d4b56825dd93 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:10.775535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1202/2436] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:12.451404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:12.463054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54255-95e2-4caf-8c9e-22dcfa364062 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:12.466606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:12.467251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:12.467535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:12.467812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:12.470064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:12.535139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:12.536641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:12.546795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1235/2437] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:12.844345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:12.844943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:12.844943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:12.874347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:12.876416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:12.886902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1203/2438] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:49:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:12.951723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:12.963649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8961c-29bf-4dff-8fd9-4da793dd6c21 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:12.968967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:12.970177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:12.970468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:12.970752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:12.980916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:12.982542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:12.991707 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1236/2439] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:49:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:49:17.014574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.030692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3252ec-8a37-4359-b27c-f7ef5dcb9b43 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.035679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.040705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.040705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.040705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.042621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.061003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.062602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.074861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1204/2440] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:17.133406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.152293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4a84b-715f-40c3-ab86-b879f99835d2 service swift] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.161537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.162381 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.162816 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.163288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.165682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.180089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.201642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.229369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.229970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1237/2441] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:17.231209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.255026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6c0e6-58a0-4b18-8a56-703b4c4c2cc6 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.262409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.263126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.263705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.264176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] PATH_INFO: `/v3/users/9330e65e73394f18b87c5b1d5d47f564` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.265747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9330e65e73394f18b87c5b1d5d47f564)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.268010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.336755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9330e65e73394f18b87c5b1d5d47f564'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.337851 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9330e65e73394f18b87c5b1d5d47f564'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.358191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9330e65e73394f18b87c5b1d5d47f564'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.371491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9330e65e73394f18b87c5b1d5d47f564'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.383066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9330e65e73394f18b87c5b1d5d47f564'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.391933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1205/2442] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:17 2022] DELETE /identity/v3/users/9330e65e73394f18b87c5b1d5d47f564 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:17.599249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.612594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7b2ff-9875-4042-bfee-7b7654f3f6e0 service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.668458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.670299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.686285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.687263 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.687619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.688024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] PATH_INFO: `/v3/projects/a85ded3a20964dbbbc354199f5129d9b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.689365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85ded3a20964dbbbc354199f5129d9b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.691353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.759355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85ded3a20964dbbbc354199f5129d9b', 'request_id': 'req-41edd8ef-1e6d-4a45-8127-48184dd97d94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.765916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68863b0-a5be-445a-9b9f-c3bd3a68d684 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.767973 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85ded3a20964dbbbc354199f5129d9b', 'request_id': 'req-41edd8ef-1e6d-4a45-8127-48184dd97d94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.774960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85ded3a20964dbbbc354199f5129d9b', 'request_id': 'req-41edd8ef-1e6d-4a45-8127-48184dd97d94'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.790056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:17.795797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] The token cache is being invalidate because project a85ded3a20964dbbbc354199f5129d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:17.796276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.797775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-41edd8ef-1e6d-4a45-8127-48184dd97d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:17.803686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1238/2443] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:17 2022] DELETE /identity/v3/projects/a85ded3a20964dbbbc354199f5129d9b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:17.805667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.806172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.806860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.829249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.830880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.836172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:17.880495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.881088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.881406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.881690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.886977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.899353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.901040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ece52b-25e2-4a6b-a045-3bd90b4f62c9 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:17.913657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1206/2444] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:17.932821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1239/2445] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.934263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.934572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.935497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.956340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:17.957608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:17.966326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1207/2446] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:17.971191 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:17.982892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adae8a-5ba0-44d7-8384-051c9cdf4c13 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:17.987974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:17.988767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:17.989206 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:17.989617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:17.990361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:17.990674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:17.992301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.009595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1240/2447] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:49:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:18.010889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.026113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec71942b-0d27-49c6-b3fc-fb2d7415b505 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.032461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.033140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.033431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.033710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.034420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.037795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.081195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1208/2448] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/projects => generated 366 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:18.085709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.096706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63b4b-22ba-4a9e-9dca-5918030a4754 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.160787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.161459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.161751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.162037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.162746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.164745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.190744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1241/2449] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:18.195327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.207878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86407dad-f70c-47e2-999e-41efd30d167d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.214088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.214798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.215089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.215379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.216134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.217883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.239995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1209/2450] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:18 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:18.242547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.255997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1485f-a227-4ff3-9f8b-3cd240860684 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.262374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.263033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.263561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.263819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.264586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.266360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dfb77-eb7d-46c0-bb91-e6ccd3ed0761 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.281031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1242/2451] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:18 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:18.285645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.298359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ed9da-f910-4c27-b555-34e26a4e308c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.308963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.310500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.311024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.311370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] PATH_INFO: `/v3/projects/4840aacb500f4e1a88bc4651cd83245b/users/b2f8d78f230a4e5bb64fd5ac2972b88c/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.331727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4840aacb500f4e1a88bc4651cd83245b, user_id=b2f8d78f230a4e5bb64fd5ac2972b88c, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.334538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.359215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1210/2452] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:18 2022] PUT /identity/v3/projects/4840aacb500f4e1a88bc4651cd83245b/users/b2f8d78f230a4e5bb64fd5ac2972b88c/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:18.369913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.370202 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.370673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.403511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] MFA Rules not processed for user `b2f8d78f230a4e5bb64fd5ac2972b88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:18.404969 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:18.473638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:18.499151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1243/2453] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:18.505170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.580176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a75f-22dc-43b6-9c44-8876c07990df admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.585422 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.586102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.586385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.586662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.587822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.589352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.620695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1211/2454] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/projects => generated 366 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:18.624743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.639096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0a58c-778c-4f13-b442-ffae19245f45 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.702949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.703852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.704141 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.704456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.705158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.707109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.728809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1244/2455] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:18 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:18.733145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.744328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438489d-4f48-4042-9a12-fe6ffa44371b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.751151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.751889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.752173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.752482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.753555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.755475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.767865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1212/2456] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:18 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:18.772116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.782788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b208b48-08ba-4b10-994b-61344a5ea3f4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.787790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.789093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.789382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.789668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] PATH_INFO: `/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df/users/285e8cd452d147769129e3cfc881dc1c/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.807034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd36acd1bbf84b83a24c400d3d59d9df, user_id=285e8cd452d147769129e3cfc881dc1c, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.809822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.826498 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1245/2457] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:18 2022] PUT /identity/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df/users/285e8cd452d147769129e3cfc881dc1c/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:18.831451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.843153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3234-e894-48bd-a02f-3725660ad682 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:18.894364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:18.953339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:18.954147 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:18.955176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:18.955536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:18.956410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:18.959622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6268-b250-43c8-9ae5-97416518bb2b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:18.978990 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1213/2458] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:18 2022] GET /identity/v3/roles => generated 1427 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:18.982990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:18.998116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3283552a-6906-4df8-975c-423d4ec50347 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.007795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.009972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.010583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.011077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] PATH_INFO: `/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df/users/285e8cd452d147769129e3cfc881dc1c/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.015113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd36acd1bbf84b83a24c400d3d59d9df, user_id=285e8cd452d147769129e3cfc881dc1c, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.018873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.037110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1246/2459] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:18 2022] PUT /identity/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df/users/285e8cd452d147769129e3cfc881dc1c/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:19.048667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.050054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.050495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.085835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] MFA Rules not processed for user `285e8cd452d147769129e3cfc881dc1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:19.087077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:19.167582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1214/2460] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:19.179371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:19.181286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:19.245712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d09a6-8cbb-4d31-bfad-3e0f51c6d0d5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.250125 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.250744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.251080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.251371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.261431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.262882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439eb02-edb6-40c8-8953-ae06c6169b67 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.272876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1247/2461] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:19.754932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:19.838410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943454b0-d8d1-436c-b622-de85b3ecf30b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:19.843810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:19.844765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.845054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.845335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] PATH_INFO: `/v3/users/b2f8d78f230a4e5bb64fd5ac2972b88c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.846572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f8d78f230a4e5bb64fd5ac2972b88c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:19.848987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:19.913132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f8d78f230a4e5bb64fd5ac2972b88c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.914237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f8d78f230a4e5bb64fd5ac2972b88c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.923846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:19.938131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f8d78f230a4e5bb64fd5ac2972b88c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.952131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f8d78f230a4e5bb64fd5ac2972b88c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.961965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f8d78f230a4e5bb64fd5ac2972b88c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:19.969731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1215/2462] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:19 2022] DELETE /identity/v3/users/b2f8d78f230a4e5bb64fd5ac2972b88c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:19.974028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:19.974392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:19.974754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:19.998471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:19.999754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.071414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:20.094032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1248/2463] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:20.105814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.107650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.179794 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5b987-78ea-40a2-9f89-83f6498ea8c2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.183335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.184284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.184284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.184617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.195569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.197055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.208695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1216/2464] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:20.720972 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.722989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:20.737044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17999-8df2-44f8-b545-0aabc12bc3a4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.744077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.745612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.746084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.746539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] PATH_INFO: `/v3/projects/4840aacb500f4e1a88bc4651cd83245b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.748725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4840aacb500f4e1a88bc4651cd83245b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.752826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:20.833655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4840aacb500f4e1a88bc4651cd83245b', 'request_id': 'req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.846077 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4840aacb500f4e1a88bc4651cd83245b', 'request_id': 'req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.854212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4840aacb500f4e1a88bc4651cd83245b', 'request_id': 'req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.866630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] The token cache is being invalidate because project 4840aacb500f4e1a88bc4651cd83245b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:20.867140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.867941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:20.869644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1249/2465] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/projects/4840aacb500f4e1a88bc4651cd83245b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:20.873825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:20.884479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69eb9-9e19-42d1-9c65-3d920e15bb22 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:20.955477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:20.956509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:20.956797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:20.957075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] PATH_INFO: `/v3/users/285e8cd452d147769129e3cfc881dc1c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:20.958404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285e8cd452d147769129e3cfc881dc1c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:20.960466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.029997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285e8cd452d147769129e3cfc881dc1c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.031022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285e8cd452d147769129e3cfc881dc1c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.050975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285e8cd452d147769129e3cfc881dc1c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.062366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285e8cd452d147769129e3cfc881dc1c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.070760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.076089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285e8cd452d147769129e3cfc881dc1c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.096404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1217/2466] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:20 2022] DELETE /identity/v3/users/285e8cd452d147769129e3cfc881dc1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:21.705545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.707649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.725917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55da4f-9c4c-4597-8fa6-7c62bac7198b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.801818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.802928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.803215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.803493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] PATH_INFO: `/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.804730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd36acd1bbf84b83a24c400d3d59d9df)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.806669 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:21.865842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd36acd1bbf84b83a24c400d3d59d9df', 'request_id': 'req-22620697-a498-43e3-9d5d-17ee6a8d6e3c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.875004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd36acd1bbf84b83a24c400d3d59d9df', 'request_id': 'req-22620697-a498-43e3-9d5d-17ee6a8d6e3c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.882325 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd36acd1bbf84b83a24c400d3d59d9df', 'request_id': 'req-22620697-a498-43e3-9d5d-17ee6a8d6e3c'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.895002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:21.896813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.898303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] The token cache is being invalidate because project cd36acd1bbf84b83a24c400d3d59d9df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:21.898753 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.899436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-22620697-a498-43e3-9d5d-17ee6a8d6e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:21.901452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1250/2467] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:21 2022] DELETE /identity/v3/projects/cd36acd1bbf84b83a24c400d3d59d9df => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:21.906164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57a0d-b4d2-4ee3-b2bb-2218e337802f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.906490 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57a0d-b4d2-4ee3-b2bb-2218e337802f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.906779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a57a0d-b4d2-4ee3-b2bb-2218e337802f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.911291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40ba96-6a6a-47df-b7aa-b277878362c8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:21.913815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:21.927291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-d0a57a0d-b4d2-4ee3-b2bb-2218e337802f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:21.929559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d0a57a0d-b4d2-4ee3-b2bb-2218e337802f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:21.983124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:21.983994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:21.984275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:21.984649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] PATH_INFO: `/v3/users/bb976c109cca488aa7317c71b54e5002` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:21.986099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb976c109cca488aa7317c71b54e5002)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:21.988688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.004317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1251/2468] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:22.011992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.012738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.013034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.033732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.034945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.038966 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb976c109cca488aa7317c71b54e5002'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.039613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb976c109cca488aa7317c71b54e5002'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.043213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1252/2469] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:22.047617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.052103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb976c109cca488aa7317c71b54e5002'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.058234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b54b7d-5be7-4cb6-b724-436ffff59923 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.059994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb976c109cca488aa7317c71b54e5002'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.063782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.064462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.064746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.065024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.065837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:22.066155 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.068227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb976c109cca488aa7317c71b54e5002'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.068406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.074397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1218/2470] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:21 2022] DELETE /identity/v3/users/bb976c109cca488aa7317c71b54e5002 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:22.082928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1253/2471] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:49:22.088870 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.090384 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.156055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6618a9-6608-446a-8453-a9f16f6351c2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.161005 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.161668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.161955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.162236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.162928 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.164983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.186512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.198703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1219/2472] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/projects => generated 388 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:22.199931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.210802 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92559e9a-aedb-4536-ab77-4927b7c623c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.264000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.267774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.281553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.282400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.282892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.283176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.283872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.285898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.323922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1254/2473] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:22.327911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.339400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2d5c-470b-4f90-85e9-72aa7b032838 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.346616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.347298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.347814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.348147 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.348821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.350427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.363790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781ac5a-0ecb-4be9-ad06-8fc63f023a24 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.364123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1255/2474] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/roles => generated 1427 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:22.368313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.373303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.375677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.376153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.376696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] PATH_INFO: `/v3/projects/7fa63b33258040739dd6367d959c2250` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.379581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa63b33258040739dd6367d959c2250)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.381507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5718-7065-42e6-87fb-5ff957e28c19 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.383340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.386955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.387623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.388478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.388752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.389496 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.391158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.411252 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1256/2475] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:22.413550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.425303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed208554-748c-44d1-8274-0550e9b61d98 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.431328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.432470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.432763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.433089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] PATH_INFO: `/v3/projects/5ec445e0df044381ae21081ae4dec6ae/users/031a32a9ea754965975061fa6651cac9/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.449033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa63b33258040739dd6367d959c2250', 'request_id': 'req-0a945fbd-3971-4432-ab05-3cb82c9ae82c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.455092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec445e0df044381ae21081ae4dec6ae, user_id=031a32a9ea754965975061fa6651cac9, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.457868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.461939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa63b33258040739dd6367d959c2250', 'request_id': 'req-0a945fbd-3971-4432-ab05-3cb82c9ae82c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.470168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa63b33258040739dd6367d959c2250', 'request_id': 'req-0a945fbd-3971-4432-ab05-3cb82c9ae82c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.475935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1257/2476] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:22 2022] PUT /identity/v3/projects/5ec445e0df044381ae21081ae4dec6ae/users/031a32a9ea754965975061fa6651cac9/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:22.482066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] The token cache is being invalidate because project 7fa63b33258040739dd6367d959c2250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:22.482336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.483012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a945fbd-3971-4432-ab05-3cb82c9ae82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.485254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1220/2477] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:22 2022] DELETE /identity/v3/projects/7fa63b33258040739dd6367d959c2250 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:22.489514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.491519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.491699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.491850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.492080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.522328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] MFA Rules not processed for user `031a32a9ea754965975061fa6651cac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:22.523793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.526064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.570128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77b53-30e2-4ee3-b0d6-f7d3da545cce admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.578758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.580087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.580696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.581175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] PATH_INFO: `/v3/users/9611d2b4830c45e6bedac28b8164b7df` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.583830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9611d2b4830c45e6bedac28b8164b7df)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.589795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.608940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1221/2478] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:22.614206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.615810 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.639651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aac22-5350-4098-9ce3-86f400e7b1af None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.645146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.645989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.646283 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.646558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.647263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.649238 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.657578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9611d2b4830c45e6bedac28b8164b7df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.678807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9611d2b4830c45e6bedac28b8164b7df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.679369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:22.691518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9611d2b4830c45e6bedac28b8164b7df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.694839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9611d2b4830c45e6bedac28b8164b7df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.696043 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9611d2b4830c45e6bedac28b8164b7df'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:22.696290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1222/2479] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/projects => generated 388 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:22.700711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.704153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.721375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1258/2480] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:22 2022] DELETE /identity/v3/users/9611d2b4830c45e6bedac28b8164b7df => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:22.806626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a81da1-d427-4972-a990-61b99885aeef admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.870008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.870686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.870969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.871248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.871942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.874019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.904408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1223/2481] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:22 2022] POST /identity/v3/users => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:22.908805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.916929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.918892 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:22.919942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20b6f0-b41d-4d9a-9c32-fe3602892542 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.926101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.932800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.933115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.933387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.934322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.936048 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.936326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45e31b-9d2a-4741-8e0d-7f56c9738164 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.943180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.944039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.944321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.944638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] PATH_INFO: `/v3/projects/14f0553c5f8445d48ec0e97094ba4618` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.945911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14f0553c5f8445d48ec0e97094ba4618)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.947883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:22.948544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1259/2482] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:22 2022] GET /identity/v3/roles => generated 1427 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:22.953366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:22.965394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b8e49-3833-4b7d-a71c-d5733a252736 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:22.972106 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:22.973326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:22.973620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:22.973898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] PATH_INFO: `/v3/projects/f78bc3fb734d488d9949c9f85885bf28/users/4c37e85bb52440ef85c10a85a2b3589f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:22.992308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78bc3fb734d488d9949c9f85885bf28, user_id=4c37e85bb52440ef85c10a85a2b3589f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:22.995188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.008359 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1260/2483] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:22 2022] PUT /identity/v3/projects/f78bc3fb734d488d9949c9f85885bf28/users/4c37e85bb52440ef85c10a85a2b3589f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.012656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.015550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14f0553c5f8445d48ec0e97094ba4618', 'request_id': 'req-13cdeebe-a22c-48ba-acb7-2a1e3479b327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.022707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14f0553c5f8445d48ec0e97094ba4618', 'request_id': 'req-13cdeebe-a22c-48ba-acb7-2a1e3479b327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.032212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14f0553c5f8445d48ec0e97094ba4618', 'request_id': 'req-13cdeebe-a22c-48ba-acb7-2a1e3479b327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.045399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] The token cache is being invalidate because project 14f0553c5f8445d48ec0e97094ba4618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:23.045860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.046538 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-13cdeebe-a22c-48ba-acb7-2a1e3479b327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:23.048762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1224/2484] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:22 2022] DELETE /identity/v3/projects/14f0553c5f8445d48ec0e97094ba4618 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:23.054683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ebef6-d263-48d5-8c98-2a4d8c0a2482 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.054977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ebef6-d263-48d5-8c98-2a4d8c0a2482 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.055265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ebef6-d263-48d5-8c98-2a4d8c0a2482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.075371 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c80ebef6-d263-48d5-8c98-2a4d8c0a2482 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.076574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c80ebef6-d263-48d5-8c98-2a4d8c0a2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.083967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99deb9d-367a-4ff5-bbfe-01361fb33edb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.085795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1225/2485] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:23.088887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.089561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.089850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.090132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.090885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.092499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.093607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.094618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.094919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.106742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1261/2486] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/roles => generated 1427 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:23.107764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.109512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.115308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.116507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.122395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417e2e-dd08-4df8-9255-bc4f4d824fe7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.124250 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1226/2487] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:23.127038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.127927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.128210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.128461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.128574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] PATH_INFO: `/v3/projects/f78bc3fb734d488d9949c9f85885bf28/users/4c37e85bb52440ef85c10a85a2b3589f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.130492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78bc3fb734d488d9949c9f85885bf28, user_id=4c37e85bb52440ef85c10a85a2b3589f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.133188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0dbdbb-f06b-4636-8010-1ef4f8d04747 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.134233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.135735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.138016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039900e-bb45-44c5-bb10-6cc868d8458c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.146043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.146857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.147153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.147450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.148248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:23.149045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1262/2488] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:23 2022] PUT /identity/v3/projects/f78bc3fb734d488d9949c9f85885bf28/users/4c37e85bb52440ef85c10a85a2b3589f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.149169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.150788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.160809 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.161186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.161478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.163964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1227/2489] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:23.168162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.179024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565670e-c29c-42f9-8309-1cc62c6bf499 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.189532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] MFA Rules not processed for user `4c37e85bb52440ef85c10a85a2b3589f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.190674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.249553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.250689 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.250972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.251249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.252017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.258416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.267719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1263/2490] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:49:23.278948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.280285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.300417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1228/2491] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/projects => generated 380 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:23.302397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.346459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa4732-05cb-4720-a7ed-01f67b662875 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.373353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477796b-65ca-4a3a-b697-5cee64c79a51 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.378187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.378862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.379153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.379444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.380134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.382239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.399403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.400190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.400512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.400793 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.408305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1229/2492] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:23.409362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.418858 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea39a52-3064-4ee4-8a27-065fe7870250 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.423639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.424266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.424586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.424868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.425624 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.427239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.440831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1230/2493] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/roles => generated 1427 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:23.441781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.451631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.451799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2e81c-8e23-4bcc-92b0-a7bb7125f3c7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.457670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.458303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.458596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.458882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.459613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.461258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.469175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.470867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafc75c-193b-406f-bd9c-0d74cd91792f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.471970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1231/2494] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:23.476109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.481946 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1264/2495] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:23.486096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f61b83-7ac9-4641-9a56-8d6d64237d40 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.491129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.492031 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.492314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.492768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] PATH_INFO: `/v3/projects/257f08cba99b478db51729bf108ec901/users/6f7a1fe832af4c83b4b969729d0721e9/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.512807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=257f08cba99b478db51729bf108ec901, user_id=6f7a1fe832af4c83b4b969729d0721e9, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.516521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.537266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1232/2496] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:23 2022] PUT /identity/v3/projects/257f08cba99b478db51729bf108ec901/users/6f7a1fe832af4c83b4b969729d0721e9/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:23.538062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.538425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.538776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.558606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:23.559923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.626331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1265/2497] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:23.636234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:23.637974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:23.661131 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:23.701845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ab67-8553-4e0f-9369-d4f974c623cd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:23.706234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:23.707037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:23.707404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:23.707692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:23.718222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:23.719695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce93c6-cb9a-47f5-97ac-d243a197d11b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:23.730543 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1233/2498] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:24.205434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.217425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8891cc-53e7-493d-a74c-bca6e6ab7406 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.223414 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.224444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.224830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.225314 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] PATH_INFO: `/v3/users/031a32a9ea754965975061fa6651cac9` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.234834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031a32a9ea754965975061fa6651cac9)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.238733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.308584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031a32a9ea754965975061fa6651cac9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.324161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031a32a9ea754965975061fa6651cac9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.337144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031a32a9ea754965975061fa6651cac9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.338190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031a32a9ea754965975061fa6651cac9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.338974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031a32a9ea754965975061fa6651cac9'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:24.360491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1266/2499] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:24 2022] DELETE /identity/v3/users/031a32a9ea754965975061fa6651cac9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:24.365541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.366319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.366319 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.386085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:24.387727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.470842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1234/2500] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:24.497673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:24.499214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:24.577435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fd4db-6a44-43c4-b52a-5cb650754f28 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:24.582628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:24.583366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:24.584251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:24.584572 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:24.600488 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:24.602107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:24.608102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:24.614586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1267/2501] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:25.022306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.025209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.050677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45a9f4-6589-440c-84c1-33fa6cb8c052 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.059963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.061652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.063246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.063246 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] PATH_INFO: `/v3/projects/5ec445e0df044381ae21081ae4dec6ae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.066325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec445e0df044381ae21081ae4dec6ae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.070546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.162986 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec445e0df044381ae21081ae4dec6ae', 'request_id': 'req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.174676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec445e0df044381ae21081ae4dec6ae', 'request_id': 'req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.188273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec445e0df044381ae21081ae4dec6ae', 'request_id': 'req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.206002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] The token cache is being invalidate because project 5ec445e0df044381ae21081ae4dec6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:25.206518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.207414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.210537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1235/2502] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:25 2022] DELETE /identity/v3/projects/5ec445e0df044381ae21081ae4dec6ae => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:25.215804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.229672 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a19b7-efac-4972-bd01-10c2398ae9f3 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:25.299465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:25.300845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:25.301356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:25.301831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] PATH_INFO: `/v3/users/4c37e85bb52440ef85c10a85a2b3589f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:25.305965 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c37e85bb52440ef85c10a85a2b3589f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:25.310684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:25.393333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c37e85bb52440ef85c10a85a2b3589f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.415061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c37e85bb52440ef85c10a85a2b3589f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.431036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c37e85bb52440ef85c10a85a2b3589f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.432028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c37e85bb52440ef85c10a85a2b3589f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.433139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-31972c30-3e0b-4ba5-b140-99cefcf82cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c37e85bb52440ef85c10a85a2b3589f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:25.456728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1268/2503] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:25 2022] DELETE /identity/v3/users/4c37e85bb52440ef85c10a85a2b3589f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:25.920752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:25.926916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:25.957266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4a31ad-4236-4cbd-b535-c9a1db3a3e55 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.055562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:26.083184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.084723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.085442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.086092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] PATH_INFO: `/v3/projects/f78bc3fb734d488d9949c9f85885bf28` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.088508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78bc3fb734d488d9949c9f85885bf28)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.092562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.174629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78bc3fb734d488d9949c9f85885bf28', 'request_id': 'req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.185089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78bc3fb734d488d9949c9f85885bf28', 'request_id': 'req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.194472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78bc3fb734d488d9949c9f85885bf28', 'request_id': 'req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.209227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] The token cache is being invalidate because project f78bc3fb734d488d9949c9f85885bf28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:26.209934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.210662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-eb0a0888-278a-4fd8-b7fd-561b4ac566e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:26.215534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1236/2504] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:25 2022] DELETE /identity/v3/projects/f78bc3fb734d488d9949c9f85885bf28 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:26.222507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.223062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.223062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.243495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:26.245050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:26.320760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1269/2505] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:26.330704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.331476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.332287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.366656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:26.370355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:26.384879 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1237/2506] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:26.391159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.410207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c9c82-4052-474b-b14b-e07a1c2cfb55 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.417158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.418473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.419112 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.419819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.421278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:26.422549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.425619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.453225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1270/2507] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:49:26 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:26.465164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.497231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc6c49-c54e-4d65-8f78-0db3fe7b012a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.505045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.506090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.506766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.507213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.508536 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.512280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.555495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1238/2508] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/projects => generated 380 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:26.559731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.575608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51465a6a-1da4-45a2-beec-049bf194dde3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.580591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:26.664846 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.665783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.666418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.666418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.667292 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.672080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.705617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1271/2509] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:26.711046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.732933 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094b1ff-2182-4634-962c-9a9eaac32cb0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.740103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.741008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.741406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.741830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.742752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.744623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.761434 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1239/2510] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:26 2022] GET /identity/v3/roles => generated 1427 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:26.762194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.775211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee68e27-6b92-453c-8a64-4213cca626fb admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.784407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.785337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.785730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.786775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.787629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.789823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805474b-752b-478c-ba83-de975354ec3d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.805670 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1272/2511] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:26 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:26.807067 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:26.827225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea3bc8-3c6d-4ab9-965b-6b3d3bd60632 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:26.837860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:26.839643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.840265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.840832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] PATH_INFO: `/v3/projects/70af7509a6794e9688b05bc6e72815d8/users/03676eed8c2c48a59a341a3293a76acc/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.871708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af7509a6794e9688b05bc6e72815d8, user_id=03676eed8c2c48a59a341a3293a76acc, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:26.878737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:26.909970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1240/2512] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:26 2022] PUT /identity/v3/projects/70af7509a6794e9688b05bc6e72815d8/users/03676eed8c2c48a59a341a3293a76acc/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:26.922789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:26.923185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:26.923578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:26.963751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] MFA Rules not processed for user `03676eed8c2c48a59a341a3293a76acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:26.965255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.085689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1273/2513] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:27.087740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.185904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992f08b-568b-4ebc-91bc-fb58fcbc5584 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.193312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.194007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.194297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.195684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.195684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.198712 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.230353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:27.241327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1241/2514] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/projects => generated 382 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:27.247271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.261948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a0136-7ed5-498a-bd48-f64921bda777 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.356926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.357857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.358312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.358860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.360873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.365211 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.403398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1274/2515] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:27.407584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.420836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bef5e-3049-42ce-8f6a-5843d3da6f8c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.429019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.429936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.430226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.430516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.431274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.433097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.454397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1242/2516] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/roles => generated 1427 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:27.458350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.480883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:27.486995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b537106-e767-4fae-986b-0bd0aaf8a1ad admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.501169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.502076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.502365 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.503271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] PATH_INFO: `/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a/users/c394c705c10749bab25050b50dd2a5f7/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.526227 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af2cd3f216c42c0a02f5855d8f14c2a, user_id=c394c705c10749bab25050b50dd2a5f7, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.529313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.557366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1275/2517] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:27 2022] PUT /identity/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a/users/c394c705c10749bab25050b50dd2a5f7/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:27.559731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.572945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb371c-487a-4fd9-a657-4e55f5a65152 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.704432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.706003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.706770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.707481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.709547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.713970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95701bb-e30d-4887-96af-df9fd40518a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.729671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1243/2518] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/roles => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:27.734834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.752947 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e837e-2465-4848-97c4-77fb34a1c9db admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:27.760219 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:27.761274 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.761661 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.762016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] PATH_INFO: `/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a/users/c394c705c10749bab25050b50dd2a5f7/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.764878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af2cd3f216c42c0a02f5855d8f14c2a, user_id=c394c705c10749bab25050b50dd2a5f7, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:27.770531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:27.788181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1276/2519] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:27 2022] PUT /identity/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a/users/c394c705c10749bab25050b50dd2a5f7/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:27.805409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:27.805850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:27.806364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:27.843302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] MFA Rules not processed for user `c394c705c10749bab25050b50dd2a5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:27.845178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:27.946865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1244/2520] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:27.959326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:27.962638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:28.095030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b52c2a-a69d-4358-a825-d7daa371a8ad admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:28.101982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:28.102379 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:28.102897 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:28.103317 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:28.119136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:28.121176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba8c4-d5ba-4ba5-bc8f-eb122156889a service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:28.137644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1277/2521] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:28.998643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.235409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd5a04-0d8e-4ac1-b59b-82527e99f8c6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.260262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.264288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.264927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.267130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] PATH_INFO: `/v3/users/03676eed8c2c48a59a341a3293a76acc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.273429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=03676eed8c2c48a59a341a3293a76acc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:29.282203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:29.330622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:29.449578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03676eed8c2c48a59a341a3293a76acc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:29.462077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03676eed8c2c48a59a341a3293a76acc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:29.501817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03676eed8c2c48a59a341a3293a76acc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:29.513013 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03676eed8c2c48a59a341a3293a76acc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:29.523632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03676eed8c2c48a59a341a3293a76acc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:29.535197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1245/2522] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:28 2022] DELETE /identity/v3/users/03676eed8c2c48a59a341a3293a76acc => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:29.538454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.541638 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.542502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.596104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:29.598548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:29.738002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1278/2523] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:29.748394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:29.750576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:29.934288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f723d1e-1183-46d7-afb6-6b58c84081ef admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:29.953877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:29.955972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:29.956622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:29.958778 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:29.998666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:30.001312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:30.047735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1246/2524] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:49:31.189223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:31.190926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:31.230347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986b7fb-4c7c-4592-bf16-a58001ce5a9f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:31.239686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:31.241123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:31.241680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:31.242270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] PATH_INFO: `/v3/projects/70af7509a6794e9688b05bc6e72815d8` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:31.244004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70af7509a6794e9688b05bc6e72815d8)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:31.246530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:31.356855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70af7509a6794e9688b05bc6e72815d8', 'request_id': 'req-5ca43959-8252-4959-9708-e6945bd62371'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.369552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70af7509a6794e9688b05bc6e72815d8', 'request_id': 'req-5ca43959-8252-4959-9708-e6945bd62371'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.380565 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70af7509a6794e9688b05bc6e72815d8', 'request_id': 'req-5ca43959-8252-4959-9708-e6945bd62371'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.387764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:31.404085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] The token cache is being invalidate because project 70af7509a6794e9688b05bc6e72815d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:31.404880 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.406699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5ca43959-8252-4959-9708-e6945bd62371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.409829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1279/2525] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:31 2022] DELETE /identity/v3/projects/70af7509a6794e9688b05bc6e72815d8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:31.413781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:31.430812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a47-c38a-43d2-b054-7d1429cdfb03 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:31.573756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:31.575799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:31.576790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:31.577730 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] PATH_INFO: `/v3/users/c394c705c10749bab25050b50dd2a5f7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:31.580867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c394c705c10749bab25050b50dd2a5f7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:31.584759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:31.672760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:31.701826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c394c705c10749bab25050b50dd2a5f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.704340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c394c705c10749bab25050b50dd2a5f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.725421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c394c705c10749bab25050b50dd2a5f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.741278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c394c705c10749bab25050b50dd2a5f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.757217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c394c705c10749bab25050b50dd2a5f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:31.776753 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1247/2526] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:49:31 2022] DELETE /identity/v3/users/c394c705c10749bab25050b50dd2a5f7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:31.851520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:31.851865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:31.852179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:31.896976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] MFA Rules not processed for user `6f7a1fe832af4c83b4b969729d0721e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:31.901815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.057926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1280/2527] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:32.064505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.067070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.172056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df852fa-0769-46d5-9c8a-f0e0f8780d85 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.178337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.179281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.179575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.179962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.180814 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.183182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.229401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1248/2528] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:32 2022] POST /identity/v3/projects => generated 380 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:32.230651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.247567 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df227-d9ac-4b60-b6c8-12668db3a02e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.250861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.252717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.342323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.343163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.343559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.343980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.344984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.350088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92352a-0278-4433-a667-2e5e086d1862 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.353069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.355191 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.356092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.356500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.357021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] PATH_INFO: `/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.357996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af2cd3f216c42c0a02f5855d8f14c2a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.360695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.397166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1281/2529] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:32 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:32.399595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.411853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb747cc-9c62-4c78-9780-8daff94bbb14 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.417412 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.418695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.419124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.419577 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.420568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.423088 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.439418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1282/2530] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:32 2022] GET /identity/v3/roles => generated 1427 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:32.444303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.454091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:32.457116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf75a2-4b1e-415c-bb30-a7620a776290 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.479225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af2cd3f216c42c0a02f5855d8f14c2a', 'request_id': 'req-9cf8cdfc-248a-414c-be96-d519b6acfac9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:32.494241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af2cd3f216c42c0a02f5855d8f14c2a', 'request_id': 'req-9cf8cdfc-248a-414c-be96-d519b6acfac9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:32.514722 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af2cd3f216c42c0a02f5855d8f14c2a', 'request_id': 'req-9cf8cdfc-248a-414c-be96-d519b6acfac9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:32.541776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] The token cache is being invalidate because project 1af2cd3f216c42c0a02f5855d8f14c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:49:32.542827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:32.543625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9cf8cdfc-248a-414c-be96-d519b6acfac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:49:32.548646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.551176 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.552168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.552664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] PATH_INFO: `/v3/projects/284701b4bf6c45e0ad6facc28680c868/users/550df0d2ca204a74a36a634ee5b08e0f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.554590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1249/2531] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:49:32 2022] DELETE /identity/v3/projects/1af2cd3f216c42c0a02f5855d8f14c2a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:32.558153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a974ae-b054-4878-af80-d2d16ad46423 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.558487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a974ae-b054-4878-af80-d2d16ad46423 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.559101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a974ae-b054-4878-af80-d2d16ad46423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.560727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:32.580721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284701b4bf6c45e0ad6facc28680c868, user_id=550df0d2ca204a74a36a634ee5b08e0f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.583771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.594400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6a974ae-b054-4878-af80-d2d16ad46423 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:32.599865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6a974ae-b054-4878-af80-d2d16ad46423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.604555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1283/2532] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:32 2022] PUT /identity/v3/projects/284701b4bf6c45e0ad6facc28680c868/users/550df0d2ca204a74a36a634ee5b08e0f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:49:32.609344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.614497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.730705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade50161-fb2b-47b2-8776-5dd92db44905 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.740019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1250/2533] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:32.753436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.754024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.754517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.758262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.759357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.760172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.760937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.761889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.764738 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.779505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1284/2534] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:32 2022] GET /identity/v3/roles => generated 1427 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:32.785480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.792711 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:32.795170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:32.803503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff489dd-1281-4f57-80b5-036df9178d30 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.816562 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1251/2535] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:32.821495 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:32.828804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.830557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.831216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.831800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] PATH_INFO: `/v3/projects/284701b4bf6c45e0ad6facc28680c868/users/550df0d2ca204a74a36a634ee5b08e0f/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.836342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284701b4bf6c45e0ad6facc28680c868, user_id=550df0d2ca204a74a36a634ee5b08e0f, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.839184 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.839525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad7bff-44bc-45c9-9d30-f0b803033a83 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:32.848090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:32.848889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:32.849653 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:32.850105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:32.850872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:49:32.851222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:32.853340 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:32.857160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1285/2536] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:32 2022] PUT /identity/v3/projects/284701b4bf6c45e0ad6facc28680c868/users/550df0d2ca204a74a36a634ee5b08e0f/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:32.878767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1252/2537] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:49:32 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 16:49:32.883812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.030357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b982d5e-43dd-40df-a7a8-f53cd539ebe4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.039033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.039837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.040161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.040584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.041687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.045335 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.100941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1286/2538] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:49:32 2022] POST /identity/v3/projects => generated 372 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:49:33.102356 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.118628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4e791-19e3-432d-abd6-cd7e022e6935 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.255264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.257200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.257372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.258009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.259687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.264419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.323640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1253/2539] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:49:33 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:49:33.328250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.340185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad4707-f334-4af8-9e67-d8590314e9c8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.346289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.346671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.346964 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.347247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.347989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.350046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.362355 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1287/2540] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:33 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 16:49:33.366904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.380124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3ee2d-68d1-431a-9a66-eb48601567cf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.406348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.407036 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.407323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.407603 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.408360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.415154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027aea48-dd0d-42ba-9d23-682199fc861e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.428270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.434175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1254/2541] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:49:33 2022] GET /identity/v3/roles => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:49:33.440858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a717c84-004e-4ab9-8686-e2dff085f044 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.449120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.450392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.450879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.451310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] PATH_INFO: `/v3/projects/bb527f1301e8458bafd3871115738b69/users/bf4c8fb8e9b649d79455eacdfe66bc5f/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.485957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb527f1301e8458bafd3871115738b69, user_id=bf4c8fb8e9b649d79455eacdfe66bc5f, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.492019 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.512648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1288/2542] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:49:33 2022] PUT /identity/v3/projects/bb527f1301e8458bafd3871115738b69/users/bf4c8fb8e9b649d79455eacdfe66bc5f/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:49:33.525545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4283b-bf09-4ddf-95ce-d4a38e30290d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.526149 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4283b-bf09-4ddf-95ce-d4a38e30290d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.526256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4283b-bf09-4ddf-95ce-d4a38e30290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.575718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b1b4283b-bf09-4ddf-95ce-d4a38e30290d None None] MFA Rules not processed for user `bf4c8fb8e9b649d79455eacdfe66bc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:33.578852 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b1b4283b-bf09-4ddf-95ce-d4a38e30290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:33.601649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:33.702241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1255/2543] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:33.718530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:33.721332 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:33.746369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:33.815857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e2f1-711f-48ad-a934-543005142313 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:33.821933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:33.822160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.822354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.822676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.841699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c93cd-2c72-4293-b343-52cea99466da None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:33.842755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c93cd-2c72-4293-b343-52cea99466da None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:33.844111 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c93cd-2c72-4293-b343-52cea99466da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:33.845619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:33.847033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:33.860294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1289/2544] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:33.895037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-016c93cd-2c72-4293-b343-52cea99466da None None] MFA Rules not processed for user `2e5e1735e7f54f2d8943a0f55311394b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:33.896361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-016c93cd-2c72-4293-b343-52cea99466da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:34.002548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1256/2545] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:34.851948 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:34.854429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:35.011968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421cf41-a930-40f3-bbd3-421535c0de46 service glance] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:35.023238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:35.025244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:35.025984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:35.026472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:35.032994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:35.053504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:35.056339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:35.070935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1290/2546] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:41.575593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460944-323d-4cf2-9b77-6752bf67d12c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.576117 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460944-323d-4cf2-9b77-6752bf67d12c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.576216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b460944-323d-4cf2-9b77-6752bf67d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.609526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2b460944-323d-4cf2-9b77-6752bf67d12c None None] MFA Rules not processed for user `550df0d2ca204a74a36a634ee5b08e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:49:41.610850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b460944-323d-4cf2-9b77-6752bf67d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.718622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1257/2547] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:49:41 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:49:41.742491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:49:41.743646 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:41.959532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef1ff6-7559-4a86-a1e8-74c6a941ff8e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:49:41.967350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:49:41.968205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:49:41.968657 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:49:41.969008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:49:41.971246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:49:42.063842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:49:42.066444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:49:42.079520 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:49:42.095416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1291/2548] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:49:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:49:51.713742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=80 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:18.358831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596394-1276-4961-8693-f012d9e8d593 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:18.359511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596394-1276-4961-8693-f012d9e8d593 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:18.359511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da596394-1276-4961-8693-f012d9e8d593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:18.372745 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:18.382825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-da596394-1276-4961-8693-f012d9e8d593 None None] MFA Rules not processed for user `6f7a1fe832af4c83b4b969729d0721e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:18.383913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da596394-1276-4961-8693-f012d9e8d593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:18.391550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1258/2549] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:18.444789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad4651-5926-43ff-a0f9-de56335f15b1 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:18.449563 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:18.450460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:18.450741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:18.451057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] PATH_INFO: `/v3/users/bf4c8fb8e9b649d79455eacdfe66bc5f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:18.452246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4c8fb8e9b649d79455eacdfe66bc5f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:18.454225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:18.514378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4c8fb8e9b649d79455eacdfe66bc5f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:18.531814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4c8fb8e9b649d79455eacdfe66bc5f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:18.540843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4c8fb8e9b649d79455eacdfe66bc5f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:18.541459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4c8fb8e9b649d79455eacdfe66bc5f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:18.542084 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4c8fb8e9b649d79455eacdfe66bc5f'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:18.557238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1292/2550] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:50:18 2022] DELETE /identity/v3/users/bf4c8fb8e9b649d79455eacdfe66bc5f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:18.561726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:18.562022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:18.562306 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:18.582522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:18.583781 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:18.656674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1259/2551] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:18.667956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:18.670165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:18.738071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90a1fa-1bd7-409c-9783-fd75e0171ee3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:18.741962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:18.742767 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:18.743045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:18.743324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:18.756323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:18.759009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce268c-848f-49ad-a361-dcd3124e1192 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:18.777861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1293/2552] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:19.220487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.221905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.233940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b362eb-df4a-4048-8054-c1c47f6e958b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.239617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.240702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.240994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.241369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] PATH_INFO: `/v3/projects/bb527f1301e8458bafd3871115738b69` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.242829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb527f1301e8458bafd3871115738b69)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.245224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.296466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb527f1301e8458bafd3871115738b69', 'request_id': 'req-7e4cd354-bbad-4ff7-9915-cfddda4829c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:19.305121 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb527f1301e8458bafd3871115738b69', 'request_id': 'req-7e4cd354-bbad-4ff7-9915-cfddda4829c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:19.321529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb527f1301e8458bafd3871115738b69', 'request_id': 'req-7e4cd354-bbad-4ff7-9915-cfddda4829c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:19.337001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] The token cache is being invalidate because project bb527f1301e8458bafd3871115738b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:50:19.337296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:19.338475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7e4cd354-bbad-4ff7-9915-cfddda4829c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:50:19.343506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1260/2553] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:50:19 2022] DELETE /identity/v3/projects/bb527f1301e8458bafd3871115738b69 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:19.344997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.345294 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.345581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.367981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:19.369333 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.390517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.436850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1294/2554] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:19.445235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.445727 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.446211 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.464869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:19.466194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.474506 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1261/2555] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:19.479013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.491451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7501f-5ff5-4d97-9668-572e335f7362 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.496240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.496995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.497486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.497857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.498667 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:50:19.499061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.500899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.516405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1295/2556] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:50:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:50:19.518405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.528583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2421be59-93b0-49de-939f-f1d05efc5d4f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.535190 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.536004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.536320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.536607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.537321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.539252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.572249 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1262/2557] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/projects => generated 364 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:19.573495 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.584063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523712-ea0a-4a49-8d89-9e1ac0bc9764 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.647584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.648295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.648616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.649463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.649608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.651730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.676062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1296/2558] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:50:19.677397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.689435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61d172-9319-4016-9116-dde68c998a92 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.695462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.696357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.696725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.697072 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.697871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.699544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.711259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1263/2559] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:19.715253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.725952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3dc4c-41b8-499c-8d75-d5ea241944ca admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.730923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.731612 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.732557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.732869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.733613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.735228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98cc1d7-1d01-4b04-a70f-d6d1da6312ed admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.746195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1297/2560] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:50:19 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:50:19.750439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.760670 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73972cf8-a7d4-428d-a5ba-5df20e0e45d2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:19.765414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:19.766291 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.766578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.766857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] PATH_INFO: `/v3/projects/8c9d323a16374f09953870c49c42a512/users/1af9ee27608843dfae675f4d020844c6/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.782685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9d323a16374f09953870c49c42a512, user_id=1af9ee27608843dfae675f4d020844c6, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:19.785417 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:19.801157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1264/2561] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:50:19 2022] PUT /identity/v3/projects/8c9d323a16374f09953870c49c42a512/users/1af9ee27608843dfae675f4d020844c6/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:50:19.813444 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:19.813739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:19.814040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:19.844158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] MFA Rules not processed for user `1af9ee27608843dfae675f4d020844c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:50:19.845546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.912855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1298/2562] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:50:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:50:19.925365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:19.927328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:19.950115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:19.997327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0262869-7a3f-4146-8fb5-098edf598898 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:20.001007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:20.001647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:20.001934 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:20.002215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:20.010416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:20.011855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:20.020710 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1265/2563] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:50:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:29.910790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:30.016635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=20 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:50:41.147890 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:50:41.149997 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:41.215860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0321f-b5b7-49a1-87bd-064258b09a3e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:50:41.219550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:50:41.220200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:50:41.220545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:50:41.220825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:50:41.222649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:50:41.293685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:50:41.295642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:50:41.306020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1299/2564] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:50:41 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:50:51.301421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=50 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:00.246376 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:00.247912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:00.259895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db413669-d852-41bf-91a0-b13f3f0094ef service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:00.264093 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:00.264766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:00.265051 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:00.265330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:00.267148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:00.339708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:00.341334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:00.353213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1266/2565] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:01.534055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:01.543238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cd539-5300-4d62-bb74-0c82e697588e service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:01.546917 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:01.547553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:01.547836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:01.548113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:01.549909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:01.564210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:01.566232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14220dfc-11af-4eb3-81ec-1a7b5c972714 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:01.577196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1300/2566] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:09.746321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:09.747843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:09.762024 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4892c1-901c-4e57-9cf6-efbe9f789556 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:09.767915 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:09.768194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:09.768629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:09.768918 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:09.770697 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:09.857472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:09.859092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:09.868325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1267/2567] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:11.477678 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.478173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.478267 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.496423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:11.497718 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:11.556807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1301/2568] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:11.604167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:11.605655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:11.674876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc36578-7ed7-4ae0-b625-0d20aa18a671 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:11.679872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:11.680544 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:11.680831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:11.681110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:11.686636 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:11.691188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:11.692867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03654e-4ee6-4d31-a11e-68a6c29b9024 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:11.701893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1268/2569] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:51:13.016627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:13.086326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c31739-ade7-4ae4-b9ba-216844701662 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:13.091179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:13.092249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.092637 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.092970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] PATH_INFO: `/v3/users/1af9ee27608843dfae675f4d020844c6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.094254 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af9ee27608843dfae675f4d020844c6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:13.096308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:13.150682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af9ee27608843dfae675f4d020844c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.164655 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af9ee27608843dfae675f4d020844c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.173250 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af9ee27608843dfae675f4d020844c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.173919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af9ee27608843dfae675f4d020844c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.174620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af9ee27608843dfae675f4d020844c6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.188011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1302/2570] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:51:13 2022] DELETE /identity/v3/users/1af9ee27608843dfae675f4d020844c6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:51:13.192766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.193285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.193388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.211909 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:13.213465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.280092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1269/2571] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:13.286911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:13.288544 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.304977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:13.353623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da947-a514-4d83-a01f-2578edad8246 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:13.357424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:13.358362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.358362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.358653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.368180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:13.369684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f2edf-3373-4178-b271-c50d10b2350b service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:13.379188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1303/2572] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:13.679783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:13.681638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.698979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e41df7-041b-4d5b-bfc0-fa356eabdbc9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:13.705962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:13.707010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.707421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.707579 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] PATH_INFO: `/v3/projects/8c9d323a16374f09953870c49c42a512` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.709168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9d323a16374f09953870c49c42a512)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:13.711546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:13.778220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9d323a16374f09953870c49c42a512', 'request_id': 'req-8e6981f0-196d-45bb-bd4a-6e110e11da42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.785456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9d323a16374f09953870c49c42a512', 'request_id': 'req-8e6981f0-196d-45bb-bd4a-6e110e11da42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.794688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9d323a16374f09953870c49c42a512', 'request_id': 'req-8e6981f0-196d-45bb-bd4a-6e110e11da42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.809276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] The token cache is being invalidate because project 8c9d323a16374f09953870c49c42a512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:51:13.809631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.810278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e6981f0-196d-45bb-bd4a-6e110e11da42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:13.812437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1270/2573] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:51:13 2022] DELETE /identity/v3/projects/8c9d323a16374f09953870c49c42a512 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:13.818158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.818699 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.818995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.838442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:13.840217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.919385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1304/2574] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:51:13.927178 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.927561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.928141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.949647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:13.950952 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:13.959804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1271/2575] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:13.964238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:13.976926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d453f7-0c5d-4ce1-80e2-c2f821bce298 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:13.983306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:13.983975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:13.984264 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:13.984595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:13.985329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:51:13.985631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:13.987245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.001797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1305/2576] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:51:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:51:14.005666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.016046 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd30b2-96c3-4a39-a278-32290891ac69 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.021866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.022533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.022822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.023101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.023855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.025806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.060312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1272/2577] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:51:14 2022] POST /identity/v3/projects => generated 390 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:51:14.067463 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.080962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ee19-4333-46c4-b1c8-b369d262e034 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.140942 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.141731 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.142022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.142308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.143001 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.144968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.166386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1306/2578] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:51:14 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:51:14.170532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.181953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1af36-6eb2-4f93-ae0a-e44c3cea1618 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.187295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.187995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.188310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.188628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.189378 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.191528 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.209448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1273/2579] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:51:14 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:51:14.211407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.230240 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de484681-3b09-4c93-9cf4-84ad11182679 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.235609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.236307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.236645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.236912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.237639 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.239322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03635-f0c4-4b32-a135-8110c93045f3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.251805 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1307/2580] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:51:14 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:51:14.256043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.266884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e170130-0fb8-4412-8f80-e36a50faa828 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.271877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.272997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.273282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.273564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] PATH_INFO: `/v3/projects/1cc756b0eb5942be967010558e0aa644/users/a5f640f19a0a44c0b3fc4487f8b08687/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.289539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc756b0eb5942be967010558e0aa644, user_id=a5f640f19a0a44c0b3fc4487f8b08687, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.292774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.309007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1274/2581] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:51:14 2022] PUT /identity/v3/projects/1cc756b0eb5942be967010558e0aa644/users/a5f640f19a0a44c0b3fc4487f8b08687/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:14.321100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.321421 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.321711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.350857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] MFA Rules not processed for user `a5f640f19a0a44c0b3fc4487f8b08687`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:14.351959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:14.361881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:14.437533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1308/2582] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:14.449227 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:14.450960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:14.466886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:14.526517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbf5f6-47ec-45da-89d5-6f1e04855c27 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:14.531101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:14.531768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:14.532056 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:14.532547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:14.542470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:14.544475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5405c34-0358-4f24-b622-0f16f42d641a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:14.556276 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1275/2583] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:24.433728 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=23 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:24.551130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=20 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:27.529690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:27.531195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:27.588706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceab8b9-ba36-427e-baa5-bcc3197e837b None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:27.592985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:27.593631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:27.593923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:27.594203 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:27.595993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:27.605588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:27.607024 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5b757-e7d7-453d-aafc-e2847a429ce0 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:27.615173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1309/2584] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:36.285037 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.285691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.285893 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.287388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1276/2585] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:51:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:36.294132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a36-c3cd-4fee-acd6-c079f84d0608 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.294704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a36-c3cd-4fee-acd6-c079f84d0608 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.295128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a36-c3cd-4fee-acd6-c079f84d0608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.325177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-2eaf0a36-c3cd-4fee-acd6-c079f84d0608 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:36.326497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-2eaf0a36-c3cd-4fee-acd6-c079f84d0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:36.399836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1310/2586] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:36.413309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:36.415025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:36.475829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2eba6c-4990-46cd-8459-51709915583e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:36.479582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:36.480872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.481175 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.481452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.492400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:36.493869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50e2ee-32ff-4d27-abbe-c4ae5afb19d4 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:36.505163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1277/2587] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:36.576171 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.576486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.576771 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] PATH_INFO: `/` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.578154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1311/2588] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:51:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) May 26 16:51:36.583087 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439096bb-c55f-49eb-8b87-2a6b2711da19 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.583796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439096bb-c55f-49eb-8b87-2a6b2711da19 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.583796 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439096bb-c55f-49eb-8b87-2a6b2711da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.623298 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-439096bb-c55f-49eb-8b87-2a6b2711da19 None None] MFA Rules not processed for user `1a13a32aadcf43d681c5aeef7c9e1fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:36.624576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-439096bb-c55f-49eb-8b87-2a6b2711da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:36.631260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1278/2589] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:36.643833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:36.645758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:36.659887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3959b4c-0256-4769-951a-46742e6e21d3 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:36.663451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:36.664100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.664409 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.664696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.672978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:36.674415 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcdc6ca-7fad-400b-a7a2-892521ebf62e service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:36.682626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1312/2590] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:36.767452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588fe2-837c-44fe-80ac-8bd4ed82130b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.767741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588fe2-837c-44fe-80ac-8bd4ed82130b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.768028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2588fe2-837c-44fe-80ac-8bd4ed82130b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.769452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1279/2591] 10.222.0.102 () {54 vars in 926 bytes} [Thu May 26 16:51:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) May 26 16:51:36.775369 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.775701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.775987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.796873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] MFA Rules not processed for user `bf8a03a9bb9848c0a51808883cb9f929`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:36.798089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:36.810096 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1313/2592] 10.222.0.102 () {58 vars in 1023 bytes} [Thu May 26 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:36.821018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588fe2-837c-44fe-80ac-8bd4ed82130b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:36.832514 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2588fe2-837c-44fe-80ac-8bd4ed82130b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:36.837592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:36.838323 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:36.838784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:36.839074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:36.850916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:36.856075 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51782d31-53ca-45fb-8cc9-1d19ccb2e66b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:36.867998 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1280/2593] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:36.935933 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:36.937393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:37.015347 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa756819-d82f-473f-b66a-88fe05888cb2 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:37.020438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:37.021093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:37.021380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:37.021666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:37.023456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:37.036504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:37.038098 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:37.048780 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1314/2594] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:38.822057 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:38.822530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:38.822632 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:38.841084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:38.842278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:38.898081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1281/2595] 10.222.0.102 () {58 vars in 1014 bytes} [Thu May 26 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:38.910162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:38.911622 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:38.918179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:38.984014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167e87a-f024-44c5-8283-d4a2f96088a6 service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:38.993970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:38.994651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:38.994936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:38.995214 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:39.004300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:39.005925 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7107f-737c-4d03-83b7-b349d9f56afd service swift] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:39.014010 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1315/2596] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:51:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:51:39.279706 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:39.391206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bf04b-64bf-4507-9263-cb96b2878399 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:39.397867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:39.398850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:39.399199 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:39.399578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] PATH_INFO: `/v3/users/a5f640f19a0a44c0b3fc4487f8b08687` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:39.400914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f640f19a0a44c0b3fc4487f8b08687)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:39.403783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:39.427327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:39.483420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f640f19a0a44c0b3fc4487f8b08687'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:39.484217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f640f19a0a44c0b3fc4487f8b08687'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:39.501170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f640f19a0a44c0b3fc4487f8b08687'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:39.512830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f640f19a0a44c0b3fc4487f8b08687'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:39.528770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f640f19a0a44c0b3fc4487f8b08687'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:39.540202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1282/2597] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:51:39 2022] DELETE /identity/v3/users/a5f640f19a0a44c0b3fc4487f8b08687 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:39.542711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:39.543008 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:39.543289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:39.561639 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:51:39.562983 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:39.634032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1316/2598] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:51:39.644140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:39.645558 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:39.711360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad75422-7df4-4be2-bc02-cd01ce7491e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:39.717559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:39.718593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:39.718988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:39.719366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:39.731244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:39.732848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:39.743512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1283/2599] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:40.117715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:40.119732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:40.137752 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21d646-e55e-4419-8148-6b56187798d4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:40.143004 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:40.143732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:40.144197 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:40.144310 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] PATH_INFO: `/v3/projects/1cc756b0eb5942be967010558e0aa644` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:40.145856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc756b0eb5942be967010558e0aa644)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:40.148993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:40.221871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc756b0eb5942be967010558e0aa644', 'request_id': 'req-948df1b9-447a-4f25-85d5-240bb823a3d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:40.232506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc756b0eb5942be967010558e0aa644', 'request_id': 'req-948df1b9-447a-4f25-85d5-240bb823a3d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:40.240032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc756b0eb5942be967010558e0aa644', 'request_id': 'req-948df1b9-447a-4f25-85d5-240bb823a3d3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:40.253518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] The token cache is being invalidate because project 1cc756b0eb5942be967010558e0aa644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:51:40.254014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:40.254687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:51:40.256406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1317/2600] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:51:40 2022] DELETE /identity/v3/projects/1cc756b0eb5942be967010558e0aa644 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:51:41.152692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:41.163649 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5a954-adfb-4e23-a3f1-158ec74f1b43 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:41.244963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:41.245662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:41.246140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:41.246427 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:41.248789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:41.330919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:41.344914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:41.346950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:41.359120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1284/2601] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:51:50.249732 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:51.353380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:51:59.489101 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:51:59.490891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:59.503920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948df1b9-447a-4f25-85d5-240bb823a3d3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:51:59.509538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:51:59.510791 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:51:59.511082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:51:59.511366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:51:59.513360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:51:59.577795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:51:59.579251 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18114fbe-330f-4833-9666-2fc547b74364 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:51:59.589272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1318/2602] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:51:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:00.478731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:00.481366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:00.573669 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b6ff-84d7-4e53-a9bb-6ee55183237f service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:00.580160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:00.580888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:00.581762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:00.582054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:00.584026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:00.597744 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:00.599672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:00.612565 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1285/2603] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:02.747955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:02.748866 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:02.749306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:02.769604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] MFA Rules not processed for user `2822bb6d0cb3450498fcdbc85d51070f`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:02.770819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:02.866754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1319/2604] 10.222.0.102 () {58 vars in 972 bytes} [Thu May 26 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:52:02.881676 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:02.883188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:02.991618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c33713-3a61-4861-ae39-4a43a6415d97 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:02.997349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34368002fec64283a184b548b246f345', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:02.999369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:02.999369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:02.999369 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:03.008410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:03.010658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:03.022193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1286/2605] 10.222.0.102 () {60 vars in 1389 bytes} [Thu May 26 16:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 16:52:06.167057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:06.172723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:06.191912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe34386-c9fe-4126-ad7d-fa8203dfde79 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:06.196907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:06.197861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:06.198146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:06.198425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] PATH_INFO: `/v3/users/c2f7cb90a5d74658ac55943d37d28737` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:06.199930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f7cb90a5d74658ac55943d37d28737)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:06.201826 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:06.257747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f7cb90a5d74658ac55943d37d28737'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.269981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f7cb90a5d74658ac55943d37d28737'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.277253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f7cb90a5d74658ac55943d37d28737'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.277891 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f7cb90a5d74658ac55943d37d28737'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.278503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f7cb90a5d74658ac55943d37d28737'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.291469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1320/2606] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:52:06 2022] DELETE /identity/v3/users/c2f7cb90a5d74658ac55943d37d28737 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:06.468801 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:06.483887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb9494-5c2c-4504-b1d7-6c0835658219 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:06.552299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:06.553205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:06.554360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:06.554360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] PATH_INFO: `/v3/projects/a5ffc538830947bbbfd272fb857cbc03` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:06.554942 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ffc538830947bbbfd272fb857cbc03)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:06.556951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:06.576307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:06.606859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ffc538830947bbbfd272fb857cbc03', 'request_id': 'req-90096598-1c5c-4317-b34a-00c272f952d3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.612180 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ffc538830947bbbfd272fb857cbc03', 'request_id': 'req-90096598-1c5c-4317-b34a-00c272f952d3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.619399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ffc538830947bbbfd272fb857cbc03', 'request_id': 'req-90096598-1c5c-4317-b34a-00c272f952d3'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.630336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] The token cache is being invalidate because project a5ffc538830947bbbfd272fb857cbc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:52:06.630626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.631252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.632826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1287/2607] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:52:06 2022] DELETE /identity/v3/projects/a5ffc538830947bbbfd272fb857cbc03 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:06.637683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:06.639032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:06.652571 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd6a43-d0c5-4340-82ac-b0aaf22fe996 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:06.660660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:06.712190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:06.713768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:06.714050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:06.714326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] PATH_INFO: `/v3/users/30dd60de0bf7444b998dde5bb6f74bbf` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:06.715505 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dd60de0bf7444b998dde5bb6f74bbf)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:06.717458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:06.762960 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dd60de0bf7444b998dde5bb6f74bbf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.774721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dd60de0bf7444b998dde5bb6f74bbf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.782554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dd60de0bf7444b998dde5bb6f74bbf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.783270 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dd60de0bf7444b998dde5bb6f74bbf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.783957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dd60de0bf7444b998dde5bb6f74bbf'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:06.796212 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1321/2608] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:52:06 2022] DELETE /identity/v3/users/30dd60de0bf7444b998dde5bb6f74bbf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:06.970055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:06.971532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:06.985360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90096598-1c5c-4317-b34a-00c272f952d3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:07.045790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:07.046654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:07.046940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:07.047218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] PATH_INFO: `/v3/projects/4a57463b71824127bb0c2438ee4a66cc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:07.048424 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a57463b71824127bb0c2438ee4a66cc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:07.050346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:07.099569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a57463b71824127bb0c2438ee4a66cc', 'request_id': 'req-4bd2d999-7b8d-45db-aaa3-42144343eec7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:07.105618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a57463b71824127bb0c2438ee4a66cc', 'request_id': 'req-4bd2d999-7b8d-45db-aaa3-42144343eec7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:07.113062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a57463b71824127bb0c2438ee4a66cc', 'request_id': 'req-4bd2d999-7b8d-45db-aaa3-42144343eec7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:07.124112 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] The token cache is being invalidate because project 4a57463b71824127bb0c2438ee4a66cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:52:07.124433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:07.125062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:07.126599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1288/2609] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:52:06 2022] DELETE /identity/v3/projects/4a57463b71824127bb0c2438ee4a66cc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:16.792861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:17.121101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:34.201177 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:34.202730 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:34.315070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8343a8-3757-4d7b-b203-5be83db63a29 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:34.391909 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:34.392585 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:34.392882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:34.393161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:34.395037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:34.411158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:34.413255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:34.427193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1322/2610] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:40.728735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:40.730164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:40.845630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2d999-7b8d-45db-aaa3-42144343eec7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:40.849380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:40.850023 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:40.850315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:40.850599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:40.852363 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:40.959021 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:40.960497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:40.980938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1289/2611] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:44.421709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=62 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:44.428257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:44.430222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:44.481796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5870da4-a7d7-4930-b2ee-ec5e64d04cc9 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:44.486907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:44.487831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:44.488119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:44.488426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] PATH_INFO: `/v3/users/2e5e1735e7f54f2d8943a0f55311394b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:44.507356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5e1735e7f54f2d8943a0f55311394b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:44.510037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:44.564046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5e1735e7f54f2d8943a0f55311394b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.581210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5e1735e7f54f2d8943a0f55311394b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.593921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5e1735e7f54f2d8943a0f55311394b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.594714 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5e1735e7f54f2d8943a0f55311394b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.595434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d1a3a7e7-7383-4d58-a6e9-7edb283e2a0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5e1735e7f54f2d8943a0f55311394b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.611044 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1323/2612] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:52:44 2022] DELETE /identity/v3/users/2e5e1735e7f54f2d8943a0f55311394b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:52:44.801992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:44.813390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8159d-c0c1-4422-a317-abfb4dc77514 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:44.825897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:44.883450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:44.884328 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:44.884651 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:44.884935 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] PATH_INFO: `/v3/projects/769867aa4086443a809d8fd8d3b605e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:44.896259 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=769867aa4086443a809d8fd8d3b605e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:44.898368 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:44.950845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769867aa4086443a809d8fd8d3b605e2', 'request_id': 'req-88e3f49b-0e11-4014-aaae-4ab5e78179ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.956604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769867aa4086443a809d8fd8d3b605e2', 'request_id': 'req-88e3f49b-0e11-4014-aaae-4ab5e78179ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.965033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769867aa4086443a809d8fd8d3b605e2', 'request_id': 'req-88e3f49b-0e11-4014-aaae-4ab5e78179ad'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.978025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] The token cache is being invalidate because project 769867aa4086443a809d8fd8d3b605e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:52:44.978315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.979004 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-88e3f49b-0e11-4014-aaae-4ab5e78179ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:52:44.980612 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1290/2613] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:52:44 2022] DELETE /identity/v3/projects/769867aa4086443a809d8fd8d3b605e2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:44.986087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:44.986382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:44.986659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.015542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:45.016825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:45.084530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1324/2614] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:52:45.090189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.090481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.090760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.110200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:45.111414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:45.120018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1291/2615] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:52:45.124407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.135855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a8bd-759a-44c0-874c-50c1f65380db None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.141402 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.142091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.142478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.142658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.143399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:52:45.143709 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.145360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.158303 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1325/2616] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:52:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:52:45.162816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.175120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c7f12-803f-413b-99ee-d6958fee8bc8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.180029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.181185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.181477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.181759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.182466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.184548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.213589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1292/2617] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:52:45 2022] POST /identity/v3/projects => generated 384 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:52:45.218181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.229507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad385162-068e-4c5f-95b6-836d38c62c77 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.234861 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:45.291620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.292305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.292632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.292919 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.293633 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.295564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.318395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1326/2618] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:52:45 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:52:45.322508 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.333225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9fd151-2a2a-4ddd-9b1f-11f596d5f915 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.338770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.339439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.339752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.340032 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.340795 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.342411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.354532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1293/2619] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:52:45 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:52:45.358765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.369168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af40a39-1398-4571-9d16-a991990d454f admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.373841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.374510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.374825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.375236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.375830 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.377465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231bdf3-ad6a-4a60-a8d8-eafbde2c1c24 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.387755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1327/2620] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:52:45 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:52:45.392164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.403252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21719f3-b20d-4d97-a2cc-578addd85a34 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.408001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.408984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.409212 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.409487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] PATH_INFO: `/v3/projects/c56b7ca2b1f54ae782302bead8a35b01/users/75cc85261ad441f8993877a959bdd97b/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.425949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56b7ca2b1f54ae782302bead8a35b01, user_id=75cc85261ad441f8993877a959bdd97b, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.428652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.443099 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1294/2621] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:52:45 2022] PUT /identity/v3/projects/c56b7ca2b1f54ae782302bead8a35b01/users/75cc85261ad441f8993877a959bdd97b/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:52:45.448410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934281-ce87-4c35-9eb3-ebb592c6878c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.448932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934281-ce87-4c35-9eb3-ebb592c6878c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.449045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf934281-ce87-4c35-9eb3-ebb592c6878c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.467758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-bf934281-ce87-4c35-9eb3-ebb592c6878c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:45.469011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-bf934281-ce87-4c35-9eb3-ebb592c6878c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:45.530653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1328/2622] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:52:45.540969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:45.544179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:45.582148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:52:45.608862 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafca5c-ca97-416b-9b40-e9fc1ea63476 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:45.612614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:45.613257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:45.613548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:45.613825 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:45.623770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:45.625264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:45.636779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1295/2623] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:50.202275 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d26ea-dab4-4104-8b77-dc1c7fd9fa57 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:50.202930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d26ea-dab4-4104-8b77-dc1c7fd9fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:50.202930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d26ea-dab4-4104-8b77-dc1c7fd9fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:50.231140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-915d26ea-dab4-4104-8b77-dc1c7fd9fa57 None None] MFA Rules not processed for user `75cc85261ad441f8993877a959bdd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:50.232352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-915d26ea-dab4-4104-8b77-dc1c7fd9fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:50.331532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1329/2624] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:52:50.351048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:50.352894 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:50.438330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21d277-cf08-44bd-aeb9-6d24a7ef5934 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:50.444484 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:50.445155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:50.445445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:50.445731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:50.455185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:50.456856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:50.467560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1296/2625] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:52:51.858977 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:51.859427 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:51.859743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:51.878457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] MFA Rules not processed for user `75cc85261ad441f8993877a959bdd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:52:51.879688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:51.888713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1330/2626] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:52:52.214103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:52:52.224205 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc910f-5c15-4e85-84b0-c66f1bba8e01 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:52:52.228677 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:52:52.230217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:52:52.230719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:52:52.231014 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:52:52.232968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:52:52.244058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:52:52.245553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:52:52.253926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1297/2627] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:52:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:01.872510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:02.250184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=52 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:27.245071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:27.254734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5c58a-e0fb-4668-a915-bc7656867f68 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:27.259122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:27.259824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:27.260116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:27.260432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:27.262205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:27.274172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:27.275600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:27.285287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1331/2628] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:30.126318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.128546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:30.145337 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20a6dc-9a1e-4e1f-abca-9bdfc8acde1b service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.155336 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.155551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.155938 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.156122 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] PATH_INFO: `/v3/users/e4941664ae624d4190ff53e5965db33f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.157617 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4941664ae624d4190ff53e5965db33f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.159618 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.212735 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4941664ae624d4190ff53e5965db33f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.213466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4941664ae624d4190ff53e5965db33f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.229951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4941664ae624d4190ff53e5965db33f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.239404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4941664ae624d4190ff53e5965db33f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.247884 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f5b407b-0d01-4893-8418-89477414cc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4941664ae624d4190ff53e5965db33f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.253896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1298/2629] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:53:30 2022] DELETE /identity/v3/users/e4941664ae624d4190ff53e5965db33f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:30.437149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.449550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3097-8d39-470f-ba9d-c24f60c553c6 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.517987 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.519535 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.520062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.520650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] PATH_INFO: `/v3/projects/a69cba8eb64f4fcc87bbc6960a0abeb0` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.523557 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69cba8eb64f4fcc87bbc6960a0abeb0)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.527400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.596192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'request_id': 'req-01f1f680-3a76-49f8-b06b-af16a4b8d215'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.605555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'request_id': 'req-01f1f680-3a76-49f8-b06b-af16a4b8d215'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.612683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69cba8eb64f4fcc87bbc6960a0abeb0', 'request_id': 'req-01f1f680-3a76-49f8-b06b-af16a4b8d215'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.623481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] The token cache is being invalidate because project a69cba8eb64f4fcc87bbc6960a0abeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:30.623768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.624474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-01f1f680-3a76-49f8-b06b-af16a4b8d215 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:30.626091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1332/2630] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:30 2022] DELETE /identity/v3/projects/a69cba8eb64f4fcc87bbc6960a0abeb0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:30.632736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.633035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.633313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.683487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:30.684674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:30.747714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1299/2631] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:30.755996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.756857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.757143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.776697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:30.777968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:30.786642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1333/2632] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:30.791045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.800817 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f86094-1d82-42cb-aea0-6249a2aea3dd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.805522 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.806184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.806476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.806757 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.807524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:30.807840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.809486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.822438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1300/2633] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:53:30 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:30.827152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.837323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e47639-beca-4c86-930d-4f187ee8503a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.842198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.842859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.843143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.843422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.844163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.846122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.872362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1334/2634] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:30 2022] POST /identity/v3/projects => generated 382 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:30.878007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.889229 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f17da7-e896-4c0d-a867-210a72fd05ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.925103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:30.951647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.952239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.952567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.952850 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.953537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.955468 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:30.975765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1301/2635] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:30 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:30.979911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:30.990243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9920970-719e-471f-8bfd-6b1b4f4ab839 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:30.994849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:30.995502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:30.995788 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:30.996065 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:30.996829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:30.998438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.009105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1335/2636] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:30 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:31.013027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.023476 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a91651-b355-4701-9737-d606e59623ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.028071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.028766 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.029058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.029339 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.030069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.031671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fa37b-1550-4c81-8c09-53cf77b7a50c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.042218 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1302/2637] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:31.046269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.056720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d771-9fbd-4f03-a5e5-1d9107b41d6d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.061358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.062248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.062537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.063102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] PATH_INFO: `/v3/projects/3fbf0e0e90404d2d9f336cf56a438e70/users/9319db4965b34e72b21fe97ea1ecdc37/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.077609 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbf0e0e90404d2d9f336cf56a438e70, user_id=9319db4965b34e72b21fe97ea1ecdc37, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.080305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.094241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1336/2638] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:31 2022] PUT /identity/v3/projects/3fbf0e0e90404d2d9f336cf56a438e70/users/9319db4965b34e72b21fe97ea1ecdc37/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:31.104798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.105108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.105392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.131701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] MFA Rules not processed for user `9319db4965b34e72b21fe97ea1ecdc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:31.132956 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.196123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1303/2639] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:31.200688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.215193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:31.266700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c120a-fcb9-4fee-85f1-422f16ed3f05 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.271434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.272679 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.272970 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.273253 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.273952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.275872 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.301853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1337/2640] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/projects => generated 380 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:31.306006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.317896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9441e21-e057-44dd-8c20-ceca60a740e1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.374896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.375577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.375855 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.376137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.376853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.378774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.401445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1304/2641] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:31.403364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.413824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa85a-5666-4252-940a-415af3ea4a4e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.418465 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.419120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.419410 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.419694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.420456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.422058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.432804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1338/2642] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:31.436823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.447729 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a81cb3-5565-4b16-b228-cb03e7aa17c3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.452435 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.453317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.453627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.453907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] PATH_INFO: `/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c/users/d7a243b9d54e4430b878735124e4ea15/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.469267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bacaad9a1334dc5bcef61a0514b5b5c, user_id=d7a243b9d54e4430b878735124e4ea15, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.471842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.485437 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1305/2643] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:31 2022] PUT /identity/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c/users/d7a243b9d54e4430b878735124e4ea15/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:31.489403 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.499626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ee070-3744-4288-91ab-f35b0f6d7136 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.556050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.556749 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.557036 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.557313 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.558033 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.559616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5ffd0-9002-4b32-8d88-a4a51a4c0722 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.570137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1339/2644] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/roles => generated 1427 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:31.574390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.585331 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbedce3-5828-4ac3-8548-d8872a349278 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.590009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.590889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.591321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.591498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] PATH_INFO: `/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c/users/d7a243b9d54e4430b878735124e4ea15/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.593541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bacaad9a1334dc5bcef61a0514b5b5c, user_id=d7a243b9d54e4430b878735124e4ea15, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.596203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.599341 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:31.608040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1306/2645] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:31 2022] PUT /identity/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c/users/d7a243b9d54e4430b878735124e4ea15/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:31.618790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.619090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.619376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.650594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] MFA Rules not processed for user `d7a243b9d54e4430b878735124e4ea15`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:31.651799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.720949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1340/2646] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:31.732968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.734701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:31.814871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d017-1f50-48c3-bcb5-36326648f97f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.818299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.818983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.819274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.819559 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.828749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.830188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:31.840608 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1307/2647] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:31.911992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:31.922539 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e035586-bb33-4adf-b8a0-71e275fb6faa None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:31.926166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:31.926818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:31.927130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:31.927391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:31.934110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:31.991097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:31.992586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd81515-b449-4bb1-9e92-0b21d8607271 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:32.001746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1341/2648] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:41.835913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=37 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:41.997764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=24 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:44.026575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.113309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487bc5c-6036-40bb-8428-08651119fddf service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:44.129062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:44.129993 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.130326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.131626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] PATH_INFO: `/v3/users/9319db4965b34e72b21fe97ea1ecdc37` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.133521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9319db4965b34e72b21fe97ea1ecdc37)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:44.135279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:44.195545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9319db4965b34e72b21fe97ea1ecdc37'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.196245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9319db4965b34e72b21fe97ea1ecdc37'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.212830 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9319db4965b34e72b21fe97ea1ecdc37'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.221784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9319db4965b34e72b21fe97ea1ecdc37'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.229965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9319db4965b34e72b21fe97ea1ecdc37'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.236266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1308/2649] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:53:44 2022] DELETE /identity/v3/users/9319db4965b34e72b21fe97ea1ecdc37 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:44.240553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.241063 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.241246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.260549 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:44.261792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:44.338345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1342/2650] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:44.348293 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.350039 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:44.415808 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f64871-1449-4851-aa16-0879165c5b30 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:44.419607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:44.420262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.420584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.420864 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.430811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:44.432262 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:44.442511 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1309/2651] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:44.740995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.742477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:44.754647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c394d5-53bb-4f9a-a028-3c1d8092dd03 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:44.759885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:44.760799 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.761089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.761372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] PATH_INFO: `/v3/projects/3fbf0e0e90404d2d9f336cf56a438e70` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.762620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbf0e0e90404d2d9f336cf56a438e70)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:44.764671 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:44.815487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbf0e0e90404d2d9f336cf56a438e70', 'request_id': 'req-566087dc-fa72-4e5b-8803-09c20a5bc22a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.824739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbf0e0e90404d2d9f336cf56a438e70', 'request_id': 'req-566087dc-fa72-4e5b-8803-09c20a5bc22a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.831105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbf0e0e90404d2d9f336cf56a438e70', 'request_id': 'req-566087dc-fa72-4e5b-8803-09c20a5bc22a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.841938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] The token cache is being invalidate because project 3fbf0e0e90404d2d9f336cf56a438e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:44.842226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.842857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-566087dc-fa72-4e5b-8803-09c20a5bc22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.844386 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1343/2652] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:44 2022] DELETE /identity/v3/projects/3fbf0e0e90404d2d9f336cf56a438e70 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:44.848662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:44.858370 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe90780-afcd-4601-ade9-81eacfd3fd36 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:44.876270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:44.917074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:44.917999 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:44.918286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:44.918567 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] PATH_INFO: `/v3/users/d7a243b9d54e4430b878735124e4ea15` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:44.919803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a243b9d54e4430b878735124e4ea15)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:44.921763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:44.966835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a243b9d54e4430b878735124e4ea15'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.967469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a243b9d54e4430b878735124e4ea15'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.979173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a243b9d54e4430b878735124e4ea15'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.986600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a243b9d54e4430b878735124e4ea15'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:44.994064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a243b9d54e4430b878735124e4ea15'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.000028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1310/2653] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:53:44 2022] DELETE /identity/v3/users/d7a243b9d54e4430b878735124e4ea15 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:45.185811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3914-b6d1-48a9-967a-307c31c1aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.186110 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3914-b6d1-48a9-967a-307c31c1aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.186428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c3914-b6d1-48a9-967a-307c31c1aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.205385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-3e4c3914-b6d1-48a9-967a-307c31c1aeb8 None None] MFA Rules not processed for user `6f7a1fe832af4c83b4b969729d0721e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:45.206600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-3e4c3914-b6d1-48a9-967a-307c31c1aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:45.269980 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1344/2654] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:45.274856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.276549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:45.357101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f5e64-1cd4-4549-b8ea-c75bd56b3371 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.362515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.363520 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.363827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.364106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] PATH_INFO: `/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.365929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bacaad9a1334dc5bcef61a0514b5b5c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.367969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.415242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:45.419074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bacaad9a1334dc5bcef61a0514b5b5c', 'request_id': 'req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.426270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bacaad9a1334dc5bcef61a0514b5b5c', 'request_id': 'req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.435519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bacaad9a1334dc5bcef61a0514b5b5c', 'request_id': 'req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.448461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] The token cache is being invalidate because project 6bacaad9a1334dc5bcef61a0514b5b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:45.448755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.449406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f02c20d9-1e4e-43a9-8eac-ec0f160fdf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:45.450967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1311/2655] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:45 2022] DELETE /identity/v3/projects/6bacaad9a1334dc5bcef61a0514b5b5c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:45.457119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.457418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.457724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.477840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:45.479140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:45.513307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:45.554519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1345/2656] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:45.562347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.562929 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.563173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.585860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:45.586849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:45.595844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1312/2657] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:45.599934 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.610353 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8942e-3d35-4bf4-b3cf-3c64448296d0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.615747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.616615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.616971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.617316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.618140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:45.618538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.620283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.639318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1346/2658] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:53:45 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:45.640742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.652150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6a332-6ee9-4398-a745-a313c3134e18 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.657576 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.658258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.658547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.658890 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.659604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.661652 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.691458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1313/2659] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/projects => generated 380 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:45.696363 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.707510 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332fd12-54c6-4fb3-a37e-4b34a74c00cd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.781508 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.782405 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.782867 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.783391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.784781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.788673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.822996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1347/2660] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:45.827089 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.839382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e28831-86c0-4654-b800-e5851279b2c7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.844829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.845509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.845834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.846095 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.847008 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.848785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.863643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1314/2661] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:45 2022] GET /identity/v3/roles => generated 1427 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:45.865652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.876188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3db2c-d5a8-4402-a1ce-886578ed68d1 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.881038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.882255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.882703 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.882842 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.883554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.885236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acc406-d63e-4da2-b378-9bfaa93e9ed6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.900090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1348/2662] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:45 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:45.901433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:45.912703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953f69c-b783-4f41-aae7-6ed19e766820 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:45.917512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:45.918431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.918719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.919026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] PATH_INFO: `/v3/projects/500e2b91f4c84fb2bd7c96d61b13d7ae/users/57cb4e8b86424c53a82e408370b144c4/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:45.939453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=500e2b91f4c84fb2bd7c96d61b13d7ae, user_id=57cb4e8b86424c53a82e408370b144c4, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:45.942274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:45.956922 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1315/2663] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:45 2022] PUT /identity/v3/projects/500e2b91f4c84fb2bd7c96d61b13d7ae/users/57cb4e8b86424c53a82e408370b144c4/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:45.968050 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:45.968635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:45.969127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.001015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] MFA Rules not processed for user `57cb4e8b86424c53a82e408370b144c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:46.002246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:46.081057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1349/2664] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:46.086108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.165907 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d8dd0-860b-4ef6-b684-d51cedee0bc9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.171127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.171809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.172097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.172396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.173120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.175115 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.215917 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1316/2665] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:46 2022] POST /identity/v3/projects => generated 380 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:46.219327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.235058 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f304f-2a5c-438f-9b33-990529bf239f None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.266073 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.317059 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.317863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.318733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.319122 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.319906 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.322627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.352522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1350/2666] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:46 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:46.355475 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.366989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9458e-8689-48b9-955a-ef6cee854aae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.372026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.372838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.373189 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.373532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.374342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.376035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.390228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1317/2667] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:46 2022] GET /identity/v3/roles => generated 1427 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:46.394372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.406756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda19531-6cce-494a-89bc-ae52bbe55173 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.412140 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.413241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.413626 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.414009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] PATH_INFO: `/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e/users/27637832ad92469f98e13b6b7ab6f2e4/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.436815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe3ec21d614427db96a23a9fafe0d7e, user_id=27637832ad92469f98e13b6b7ab6f2e4, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.440229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.456109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1351/2668] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:46 2022] PUT /identity/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e/users/27637832ad92469f98e13b6b7ab6f2e4/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:46.460673 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.471504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b1c99-10c2-411a-9039-aa506cf78fb5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.523420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:46.543745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.544471 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.544765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.545048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.545788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.547416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef69b76-ad13-422e-8039-f049e860b1cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.558521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1318/2669] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:46 2022] GET /identity/v3/roles => generated 1427 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:46.563195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.575400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6b1a0-9d01-47c7-ae00-3bc880c4ab4d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.582422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.585135 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.585899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.585899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] PATH_INFO: `/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e/users/27637832ad92469f98e13b6b7ab6f2e4/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.589827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe3ec21d614427db96a23a9fafe0d7e, user_id=27637832ad92469f98e13b6b7ab6f2e4, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.593869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.607288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1352/2670] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:46 2022] PUT /identity/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e/users/27637832ad92469f98e13b6b7ab6f2e4/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:46.619672 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.619971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.620317 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.666482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] MFA Rules not processed for user `27637832ad92469f98e13b6b7ab6f2e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:46.668327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:46.777374 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1319/2671] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:46.794378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:46.797257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:46.867457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1e91-e213-47fc-b275-d7fa64f85bbe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:46.873746 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:46.874459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:46.874765 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:46.875054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:46.886820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:46.888306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:46.901715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1353/2672] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:47.248517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.258736 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae635ffd-45c1-491d-99e1-2dfc885bc984 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:47.263515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27637832ad92469f98e13b6b7ab6f2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe3ec21d614427db96a23a9fafe0d7e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:47.264453 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.264583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.264793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.265532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:47.265843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:47.267462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.280628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1320/2673] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:47.284868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.294668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66d993-6685-488e-8623-c7a84542ebdb service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:47.299509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27637832ad92469f98e13b6b7ab6f2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe3ec21d614427db96a23a9fafe0d7e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:47.300165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.300493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.300787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.301512 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:47.303459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.336741 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1354/2674] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:47 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:47.341438 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.353533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e08e8-fd35-4e78-80c8-05271033bb5b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:47.417445 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27637832ad92469f98e13b6b7ab6f2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe3ec21d614427db96a23a9fafe0d7e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:47.418129 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.418457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.419098 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.420429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:47.420924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:47.423560 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.445379 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1321/2675] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:53:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:47.501764 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.519436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f0b97-3bcb-463c-b269-7836eb652c12 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:47.530922 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27637832ad92469f98e13b6b7ab6f2e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8fe3ec21d614427db96a23a9fafe0d7e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:47.532762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:47.533476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:47.534056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] PATH_INFO: `/v3/projects/6e79767164864696bfcf8e1bf022cfe6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:47.539541 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e79767164864696bfcf8e1bf022cfe6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:47.543822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:47.625538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e79767164864696bfcf8e1bf022cfe6', 'request_id': 'req-d928b30e-5a95-44f2-aacd-2243bd7fa17b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.628630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:47.635396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e79767164864696bfcf8e1bf022cfe6', 'request_id': 'req-d928b30e-5a95-44f2-aacd-2243bd7fa17b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.643868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e79767164864696bfcf8e1bf022cfe6', 'request_id': 'req-d928b30e-5a95-44f2-aacd-2243bd7fa17b'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.656662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] The token cache is being invalidate because project 6e79767164864696bfcf8e1bf022cfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:47.656992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.657862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d928b30e-5a95-44f2-aacd-2243bd7fa17b tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:47.664328 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1355/2676] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:47 2022] DELETE /identity/v3/projects/6e79767164864696bfcf8e1bf022cfe6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:47.906187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:47.909144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:47.971691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=100 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:47.997500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815b37-4d8f-4a6c-b14d-3dd73c4221f3 tempest-VolumeQuotaClassesTest-630762364 tempest-VolumeQuotaClassesTest-630762364-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.066033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.066914 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.067202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.067482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] PATH_INFO: `/v3/users/57cb4e8b86424c53a82e408370b144c4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.068751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cb4e8b86424c53a82e408370b144c4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.070742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.129779 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cb4e8b86424c53a82e408370b144c4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:48.130507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cb4e8b86424c53a82e408370b144c4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:48.144517 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cb4e8b86424c53a82e408370b144c4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:48.154731 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cb4e8b86424c53a82e408370b144c4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:48.164070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cb4e8b86424c53a82e408370b144c4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:48.172836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1322/2677] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:53:47 2022] DELETE /identity/v3/users/57cb4e8b86424c53a82e408370b144c4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:48.178289 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.178963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.179273 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.200456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:48.202220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:48.310249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1356/2678] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:48.326320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.328633 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:48.402888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18212d-ac99-49c8-bbf3-d489c50ccbde admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:48.411202 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:48.412930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:48.413461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:48.413939 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:48.429705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:48.432016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:48.460033 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1323/2679] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:48.956029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:48.958796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:48.996838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4429908a-20d7-401d-a69c-074e2a342882 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.009586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.011834 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.012323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.013038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] PATH_INFO: `/v3/projects/500e2b91f4c84fb2bd7c96d61b13d7ae` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.017234 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=500e2b91f4c84fb2bd7c96d61b13d7ae)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.021428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.125226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '500e2b91f4c84fb2bd7c96d61b13d7ae', 'request_id': 'req-cba5365c-91f3-45dd-b73f-a2301db1bc46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.141602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '500e2b91f4c84fb2bd7c96d61b13d7ae', 'request_id': 'req-cba5365c-91f3-45dd-b73f-a2301db1bc46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.154599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '500e2b91f4c84fb2bd7c96d61b13d7ae', 'request_id': 'req-cba5365c-91f3-45dd-b73f-a2301db1bc46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.174556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] The token cache is being invalidate because project 500e2b91f4c84fb2bd7c96d61b13d7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:49.174850 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.175564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.178061 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1357/2680] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:48 2022] DELETE /identity/v3/projects/500e2b91f4c84fb2bd7c96d61b13d7ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:49.183887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.196444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ad268-ea91-4591-88e1-0ee657548f1c service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.209400 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:49.298203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.301273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.301273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.301273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] PATH_INFO: `/v3/users/27637832ad92469f98e13b6b7ab6f2e4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.304512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27637832ad92469f98e13b6b7ab6f2e4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.308029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.397564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27637832ad92469f98e13b6b7ab6f2e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.398699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27637832ad92469f98e13b6b7ab6f2e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.422391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27637832ad92469f98e13b6b7ab6f2e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.436844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27637832ad92469f98e13b6b7ab6f2e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.447365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-670f2b30-69b9-4bc2-9743-df777e983462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27637832ad92469f98e13b6b7ab6f2e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.456958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1324/2681] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:53:49 2022] DELETE /identity/v3/users/27637832ad92469f98e13b6b7ab6f2e4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:53:49.811246 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:49.812996 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:49.828276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5365c-91f3-45dd-b73f-a2301db1bc46 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:49.898651 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:49.899542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:49.899831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:49.900113 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] PATH_INFO: `/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:49.901499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe3ec21d614427db96a23a9fafe0d7e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:49.903519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:49.910750 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:49.959981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe3ec21d614427db96a23a9fafe0d7e', 'request_id': 'req-2cd3a802-8486-4973-ab94-ef28305bd506'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.969592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe3ec21d614427db96a23a9fafe0d7e', 'request_id': 'req-2cd3a802-8486-4973-ab94-ef28305bd506'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.982921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe3ec21d614427db96a23a9fafe0d7e', 'request_id': 'req-2cd3a802-8486-4973-ab94-ef28305bd506'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.994443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] The token cache is being invalidate because project 8fe3ec21d614427db96a23a9fafe0d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:53:49.994824 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.995551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-2cd3a802-8486-4973-ab94-ef28305bd506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:53:49.997441 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1358/2682] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:53:49 2022] DELETE /identity/v3/projects/8fe3ec21d614427db96a23a9fafe0d7e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:50.006043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.006358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.006358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.026635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:50.028058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.103257 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1325/2683] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:50.111238 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.111680 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.111975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.134424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:50.135631 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.143639 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1359/2684] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:53:50.148478 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.158209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e04659-5b0b-4f75-9dbb-c8c1dd107084 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.162769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.163487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.163773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.164055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.164824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:53:50.165135 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.166895 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.179025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1326/2685] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:53:50.185509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.195920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6fc19-97ed-4382-883b-328a19711fed None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.200705 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.201443 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.201727 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.202005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.202708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.204652 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.232898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1360/2686] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/projects => generated 384 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:50.237055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.247650 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192b0fe-c982-48ee-b844-136bc3c0ddfa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.265219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:50.311273 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.311977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.312635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.312901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.313613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.315737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.337869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1327/2687] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:53:50.341892 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.352304 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f362e-38c1-4478-b5e6-f9b40d108a79 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.356986 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.357666 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.357951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.358233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.359474 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.360593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.372161 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1361/2688] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:50.376184 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.393113 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea460b-b3a4-45ba-ae39-32af56604813 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.401988 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.403148 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.403661 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.404171 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.405451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.408769 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50510ac-e8cd-450e-aa70-61474c8456ec admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.428867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1328/2689] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:50.433457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.445104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3c648-3826-498d-8576-95d8cf0f4965 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.450046 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.450949 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.451237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.451519 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] PATH_INFO: `/v3/projects/077628027d3545118815f49c9894ee6e/users/dcab5aa67c9a4c06a3c4aefc0af4d04c/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.470021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=077628027d3545118815f49c9894ee6e, user_id=dcab5aa67c9a4c06a3c4aefc0af4d04c, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.472758 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.486605 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1362/2690] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:50 2022] PUT /identity/v3/projects/077628027d3545118815f49c9894ee6e/users/dcab5aa67c9a4c06a3c4aefc0af4d04c/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:50.499335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.499919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.499919 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.528623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] MFA Rules not processed for user `dcab5aa67c9a4c06a3c4aefc0af4d04c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:50.529899 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:50.598741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1329/2691] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:50.603225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.666786 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a973f-4a7d-4a48-924e-0b41b4b58f43 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.671932 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.672625 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.672940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.673218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.673927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.675841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.703358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1363/2692] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/projects => generated 386 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:50.708173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.720018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03cd543-efe8-4737-b974-5f760fa07f97 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.784010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.784738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.785026 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.785314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.786028 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.788883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.815595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1330/2693] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:53:50 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:53:50.820081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.830935 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7df61-ca0d-41da-83f5-6f892b2fd126 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.835853 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.836575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.836871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.837150 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.837889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.840093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.860613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1364/2694] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1427 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:50.866688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.876906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee62df-6eee-4ba7-9ae1-5051080c5811 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:50.881658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:50.882551 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:50.882832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:50.883120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] PATH_INFO: `/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124/users/98b846bcc443477aa92b4947ff0d721d/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:50.898685 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb64f48257f4e4fbf9942c37d6ad124, user_id=98b846bcc443477aa92b4947ff0d721d, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:50.901418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:50.903821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:50.920740 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1331/2695] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:50 2022] PUT /identity/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124/users/98b846bcc443477aa92b4947ff0d721d/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:50.924857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:50.941371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:53:50.945618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b689ea-ec36-47bf-84e2-4036e07ef736 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.009624 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.010817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.010817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.010817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.011322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.012961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381d611d-2e9f-47ed-899b-e918a948cbba admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.023598 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1365/2696] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:53:50 2022] GET /identity/v3/roles => generated 1427 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:53:51.027898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.039215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1182b522-6cfe-4cc0-8217-fabb8e9653a4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.044388 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.045429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.045762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.046052 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] PATH_INFO: `/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124/users/98b846bcc443477aa92b4947ff0d721d/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.048297 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfb64f48257f4e4fbf9942c37d6ad124, user_id=98b846bcc443477aa92b4947ff0d721d, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.051034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.062848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1332/2697] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:53:51 2022] PUT /identity/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124/users/98b846bcc443477aa92b4947ff0d721d/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:53:51.074278 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.074574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.074856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.104691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] MFA Rules not processed for user `98b846bcc443477aa92b4947ff0d721d`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:53:51.105629 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:51.220611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1366/2698] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:53:51.234955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:51.238467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:51.328105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb967de-348a-4f3e-83ab-867a59861ca7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:51.331832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:51.332586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:51.332882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:51.333160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:51.398282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:51.399659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:51.409197 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1333/2699] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:53:55.640262 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:53:55.641796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:53:55.654635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0775ce-bd15-4f81-9025-116e5b46658d None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:53:55.658337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:53:55.658998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:53:55.659285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:53:55.659568 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:53:55.670167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:53:55.671619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac9341-abf1-40c3-85c2-159abf1e0302 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:53:55.681507 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1367/2700] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:53:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:00.653274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.729029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58f255-f294-4185-a3c9-ca55cd327add service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:00.733816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:00.734695 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.734991 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.735274 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] PATH_INFO: `/v3/users/dcab5aa67c9a4c06a3c4aefc0af4d04c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.736513 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcab5aa67c9a4c06a3c4aefc0af4d04c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:00.738457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:00.782857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:00.792332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcab5aa67c9a4c06a3c4aefc0af4d04c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:00.793048 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcab5aa67c9a4c06a3c4aefc0af4d04c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:00.805982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcab5aa67c9a4c06a3c4aefc0af4d04c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:00.813848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcab5aa67c9a4c06a3c4aefc0af4d04c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:00.821960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcab5aa67c9a4c06a3c4aefc0af4d04c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:00.827927 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1334/2701] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:54:00 2022] DELETE /identity/v3/users/dcab5aa67c9a4c06a3c4aefc0af4d04c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:00.832905 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:00.833542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:00.833542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:00.852784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:00.853989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:00.915950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1368/2702] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:00.926963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:00.929493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.009108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d75538-8fde-4863-8d7c-018beb550d0b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.013002 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.013937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.014436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.014958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.027692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.029773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.040751 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1335/2703] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:54:01.336040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.338320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:01.355432 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbd799-fe44-4186-b9e0-70b803256bbd None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.361086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.362016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.362305 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.362584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] PATH_INFO: `/v3/projects/077628027d3545118815f49c9894ee6e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.365458 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=077628027d3545118815f49c9894ee6e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.367747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.377756 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:01.420319 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '077628027d3545118815f49c9894ee6e', 'request_id': 'req-8b10b50e-c01c-40d5-839a-1bd24223cfc0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.428054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '077628027d3545118815f49c9894ee6e', 'request_id': 'req-8b10b50e-c01c-40d5-839a-1bd24223cfc0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.435162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '077628027d3545118815f49c9894ee6e', 'request_id': 'req-8b10b50e-c01c-40d5-839a-1bd24223cfc0'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.449138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] The token cache is being invalidate because project 077628027d3545118815f49c9894ee6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:01.449517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.450277 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.452020 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1369/2704] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:54:01 2022] DELETE /identity/v3/projects/077628027d3545118815f49c9894ee6e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:01.456017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.466085 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e76895-17da-4887-a399-69b4bf83254b service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:01.530359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:01.531239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:01.531524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:01.531802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] PATH_INFO: `/v3/users/98b846bcc443477aa92b4947ff0d721d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:01.533007 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b846bcc443477aa92b4947ff0d721d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:01.534936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:01.584930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b846bcc443477aa92b4947ff0d721d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.585525 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b846bcc443477aa92b4947ff0d721d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.598442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:01.600200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b846bcc443477aa92b4947ff0d721d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.609069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b846bcc443477aa92b4947ff0d721d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.616755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5b7da645-3096-4595-8588-dcd63f3a40b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b846bcc443477aa92b4947ff0d721d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:01.623957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1336/2705] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:54:01 2022] DELETE /identity/v3/users/98b846bcc443477aa92b4947ff0d721d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:54:01.991066 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:01.992659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.007837 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10b50e-c01c-40d5-839a-1bd24223cfc0 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.065907 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.066778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.067069 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.067354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] PATH_INFO: `/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.069138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfb64f48257f4e4fbf9942c37d6ad124)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.071087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.116712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfb64f48257f4e4fbf9942c37d6ad124', 'request_id': 'req-b3f92200-95e7-49cb-80bc-2155dfb26f82'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.123781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfb64f48257f4e4fbf9942c37d6ad124', 'request_id': 'req-b3f92200-95e7-49cb-80bc-2155dfb26f82'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.129943 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfb64f48257f4e4fbf9942c37d6ad124', 'request_id': 'req-b3f92200-95e7-49cb-80bc-2155dfb26f82'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.140683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] The token cache is being invalidate because project dfb64f48257f4e4fbf9942c37d6ad124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:02.140974 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.141617 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b3f92200-95e7-49cb-80bc-2155dfb26f82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:02.143157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1370/2706] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:54:01 2022] DELETE /identity/v3/projects/dfb64f48257f4e4fbf9942c37d6ad124 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:02.149738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.150235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.150349 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.168474 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:02.169682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.230066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1337/2707] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:02.238694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.238994 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.239281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.260422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:02.261684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.269825 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1371/2708] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:02.274859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.284671 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a80eb02-62b8-4679-9019-40848116afc8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.289314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.289964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.290252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.290534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.291263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:02.291574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.293235 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.304951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1338/2709] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:02.310301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.321659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ded77-2552-47ae-a8b9-9a289504456c None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.326849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.327551 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.327838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.328119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.328940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.330862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.351778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:02.361323 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1372/2710] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:54:02 2022] POST /identity/v3/projects => generated 384 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:02.366346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.376962 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8c723e-566e-451d-976d-d0183abceb87 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.435105 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.435792 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.436077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.436357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.437330 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.439281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.462310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1339/2711] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:54:02 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:02.466628 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.477606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba0fb-3f14-4a6e-b77e-42a149262f2a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.482823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.483487 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.483773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.484047 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.484815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.486442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.498078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1373/2712] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:02.507239 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.517659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a407-e3fb-4e7d-96cf-8d4abd8afa78 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.522431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.523745 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.524038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.524321 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.525090 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.526700 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86278e-4aca-4caf-b2e0-25d44e16c135 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.537310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1340/2713] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:02.542481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.553481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718aa1be-3044-4297-b525-c2d9e4498d3a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.558346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.559242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.559531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.559817 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] PATH_INFO: `/v3/projects/6f19f33f29ed4e519c5c5193773f7aa2/users/34277b55c6c148c2876d891bf85c1267/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.577152 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f19f33f29ed4e519c5c5193773f7aa2, user_id=34277b55c6c148c2876d891bf85c1267, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.580244 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.595899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1374/2714] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:54:02 2022] PUT /identity/v3/projects/6f19f33f29ed4e519c5c5193773f7aa2/users/34277b55c6c148c2876d891bf85c1267/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:02.608889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.609200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.609482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.640347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] MFA Rules not processed for user `34277b55c6c148c2876d891bf85c1267`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:02.641686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.674872 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:02.716360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1341/2715] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:02.728627 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:02.730476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:02.792706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bb6d5-46fb-4187-8061-40aa0f519dd5 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:02.796648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:02.797315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:02.797599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:02.797877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:02.807635 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:02.809121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:02.818581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1375/2716] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:06.275698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:06.277357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:06.376179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0307b62-0589-44be-968f-b8adc6328ed4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:06.376179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:06.376179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:06.376179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:06.376897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:06.377992 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:06.391186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:06.392838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21279e5e-51e1-4775-81cd-15a28935bd65 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:06.405064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1342/2717] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:11.466271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.535527 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45627c2a-a2cf-4ff6-b889-a6c11a7897ae service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.540228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.541126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.541418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.541694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] PATH_INFO: `/v3/users/34277b55c6c148c2876d891bf85c1267` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.542888 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34277b55c6c148c2876d891bf85c1267)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.544839 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.592715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34277b55c6c148c2876d891bf85c1267'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:11.604810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34277b55c6c148c2876d891bf85c1267'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:11.607285 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:11.613162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34277b55c6c148c2876d891bf85c1267'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:11.613941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34277b55c6c148c2876d891bf85c1267'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:11.614649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34277b55c6c148c2876d891bf85c1267'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:11.628295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1376/2718] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:54:11 2022] DELETE /identity/v3/users/34277b55c6c148c2876d891bf85c1267 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:11.633655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.634137 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.634264 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.652130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:11.653362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:11.711436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1343/2719] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:11.721040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:11.722649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:11.779258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e68ba-dc06-42d1-a413-60f48780ff3a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:11.782961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:11.783595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:11.783878 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:11.784154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:11.793664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:11.795091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e69a2-74e8-431a-8b31-4dfc4c48b0e8 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:11.805424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1377/2720] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:12.076125 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.077831 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:12.091945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91ae6-10ec-4c1f-a05e-50542c8f7acd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.097793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.098667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.099050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.099392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] PATH_INFO: `/v3/projects/6f19f33f29ed4e519c5c5193773f7aa2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.101230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f19f33f29ed4e519c5c5193773f7aa2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.103198 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.150006 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:12.153940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f19f33f29ed4e519c5c5193773f7aa2', 'request_id': 'req-78579db1-19ec-4185-88ae-ed33d5997042'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:12.159983 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f19f33f29ed4e519c5c5193773f7aa2', 'request_id': 'req-78579db1-19ec-4185-88ae-ed33d5997042'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:12.168329 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f19f33f29ed4e519c5c5193773f7aa2', 'request_id': 'req-78579db1-19ec-4185-88ae-ed33d5997042'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:12.180140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] The token cache is being invalidate because project 6f19f33f29ed4e519c5c5193773f7aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:12.180464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:12.181144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-78579db1-19ec-4185-88ae-ed33d5997042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:12.182709 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1344/2721] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:54:12 2022] DELETE /identity/v3/projects/6f19f33f29ed4e519c5c5193773f7aa2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:12.187927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.188225 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.188536 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.206248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:12.207476 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:12.269009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1378/2722] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:12.277837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.278128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.278409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.297835 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:12.299041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:12.307047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1345/2723] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 16:54:12.311451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.323180 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0210d1-496f-45cd-9992-64364b470299 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.327883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.328578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.328864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.329144 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.329885 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:12.330193 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.331795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.344390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1379/2724] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:54:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:12.348947 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.361452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54e1ff-95a3-4f85-9b0e-0815e13b5a8f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.366332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.366996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.367284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.367564 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.368260 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.370237 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.396696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1346/2725] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/projects => generated 376 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:12.400998 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.411119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535f7e9-3205-45cd-81f2-50904d7ee56d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.475497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.476182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.476478 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.476763 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.477472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.479398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.502185 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1380/2726] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:12.506904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.517512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7fe87-54d8-4746-af7b-9d641851ce82 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.523044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.523714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.524003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.524282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.525066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.526869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.539404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1347/2727] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:12.543982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.550546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:12.554376 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36e13-8fda-40da-bb60-f97bd759a901 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.560583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.561460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.562162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.562616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.563380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.565016 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73c98-9b17-4ff4-b8a1-540689e633e5 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.577009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1381/2728] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:12 2022] GET /identity/v3/roles => generated 1427 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:12.581347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.592255 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b5caa-1600-408e-b3ad-244383cb4e83 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.596921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.597798 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.598080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.598361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] PATH_INFO: `/v3/projects/c8c1f492885f4bbcb9088f50d4dcd7ec/users/c4b3a3c7eb2f4c5087c555e4d63afa3e/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.614134 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c1f492885f4bbcb9088f50d4dcd7ec, user_id=c4b3a3c7eb2f4c5087c555e4d63afa3e, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.616842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.631547 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1348/2729] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:54:12 2022] PUT /identity/v3/projects/c8c1f492885f4bbcb9088f50d4dcd7ec/users/c4b3a3c7eb2f4c5087c555e4d63afa3e/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:12.642042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.642406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.642406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.670245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] MFA Rules not processed for user `c4b3a3c7eb2f4c5087c555e4d63afa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:12.671360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:12.742578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1382/2730] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:12.753605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:12.755390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:12.820848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1f0dc9-823a-4b44-a713-269a172be909 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:12.824530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:12.825179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:12.825486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:12.825747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:12.836739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:12.838193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5199f603-7555-4f71-b528-b7b6cc225340 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:12.847455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1349/2731] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:22.739580 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=35 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:22.843035 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:37.629583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.691413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156b8f7-1134-4086-9756-83830cf8aca6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.695927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.696823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.697105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.697413 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] PATH_INFO: `/v3/users/c4b3a3c7eb2f4c5087c555e4d63afa3e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.698588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4b3a3c7eb2f4c5087c555e4d63afa3e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.700581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.747195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4b3a3c7eb2f4c5087c555e4d63afa3e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:37.758913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4b3a3c7eb2f4c5087c555e4d63afa3e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:37.765213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4b3a3c7eb2f4c5087c555e4d63afa3e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:37.765838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4b3a3c7eb2f4c5087c555e4d63afa3e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:37.766446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4b3a3c7eb2f4c5087c555e4d63afa3e'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:37.778918 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1383/2732] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:54:37 2022] DELETE /identity/v3/users/c4b3a3c7eb2f4c5087c555e4d63afa3e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:37.783527 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.784025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.784146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.801861 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:37.803059 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:37.862139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1350/2733] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:37.872538 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:37.874448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:37.931576 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0d1dc-9a87-42e0-bd26-8d19c49a154b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:37.935198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:37.935833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:37.936116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:37.936674 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:37.945742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:37.947168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c73d6-1bff-4840-b077-05f296fc2f59 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:37.956390 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1384/2734] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:38.220100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.221626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.236196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68d97-2b77-4568-a6d3-6a8d8d8703c6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.241659 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.242784 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.243141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.243332 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] PATH_INFO: `/v3/projects/c8c1f492885f4bbcb9088f50d4dcd7ec` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.244588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c1f492885f4bbcb9088f50d4dcd7ec)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.246585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.293924 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c1f492885f4bbcb9088f50d4dcd7ec', 'request_id': 'req-d430d7fc-0b28-402a-924a-517af1a3a9d0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.299537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c1f492885f4bbcb9088f50d4dcd7ec', 'request_id': 'req-d430d7fc-0b28-402a-924a-517af1a3a9d0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.306776 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c1f492885f4bbcb9088f50d4dcd7ec', 'request_id': 'req-d430d7fc-0b28-402a-924a-517af1a3a9d0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.318747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] The token cache is being invalidate because project c8c1f492885f4bbcb9088f50d4dcd7ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:54:38.319043 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.319687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d430d7fc-0b28-402a-924a-517af1a3a9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:54:38.321285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1351/2735] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:54:38 2022] DELETE /identity/v3/projects/c8c1f492885f4bbcb9088f50d4dcd7ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:38.326610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.326931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.327216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.345742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:38.346955 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.363836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:38.409082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1385/2736] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:38.418228 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.418526 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.418812 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.437322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:38.438524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.446600 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1352/2737] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:38.451406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.461429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b6837-83e9-4f4e-a00b-06cb89a4aae6 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.467183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.467845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.468139 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.468483 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.469222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 16:54:38.469543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.471408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.485089 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1386/2738] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 16:54:38.489509 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.499279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d14591-f8e5-42cd-8a36-440f6da1b77b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.504155 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.504866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.505153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.505666 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.506172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.508045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.534418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1353/2739] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/projects => generated 384 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 16:54:38.538558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.548491 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6edb0-2de2-4e93-b44b-2117a27855de admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.604945 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.605640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.605924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.606198 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.607031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.608927 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.630438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1387/2740] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 16:54:38.634459 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.645631 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fd170-409f-495d-bc30-3320486f9312 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.650173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.650840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.651126 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.651401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.652118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.653760 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.664394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1354/2741] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:38.668189 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.678382 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f287a4-e4c4-4d00-a2dd-23824b20c2cc admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.683486 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.684143 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.684462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.684743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.685497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.687343 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc54d0b-bf7d-421f-9468-fbdfcd6f3836 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.697372 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1388/2742] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 16:54:38.701951 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.712146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd33cb-7730-4ce7-a5b9-e0fa8e096e6f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.716782 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.717655 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.717936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.718213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] PATH_INFO: `/v3/projects/40687185a3f94a849d65a09026ea119c/users/427f3ca9698842b594bd2ca32f575013/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.732822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=40687185a3f94a849d65a09026ea119c, user_id=427f3ca9698842b594bd2ca32f575013, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.735456 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.748692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1355/2743] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 16:54:38 2022] PUT /identity/v3/projects/40687185a3f94a849d65a09026ea119c/users/427f3ca9698842b594bd2ca32f575013/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:54:38.754011 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f48e-cdbe-4d96-afa9-2acd0d7c3c7d None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.754297 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f48e-cdbe-4d96-afa9-2acd0d7c3c7d None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.754575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856f48e-cdbe-4d96-afa9-2acd0d7c3c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.774102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-7856f48e-cdbe-4d96-afa9-2acd0d7c3c7d None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:38.775293 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-7856f48e-cdbe-4d96-afa9-2acd0d7c3c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.835210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1389/2744] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:38.844739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:38.846457 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:38.867816 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:38.904756 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006754ee-fd43-4024-9c1b-9d6e7acef75b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:38.908352 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:38.909010 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:38.909300 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:38.909578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:38.918533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:38.919896 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:38.929163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1356/2745] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:39.550843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db01b6-318f-4bfd-be29-578a349afb4e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.551477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db01b6-318f-4bfd-be29-578a349afb4e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.551851 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db01b6-318f-4bfd-be29-578a349afb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.581543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a8db01b6-318f-4bfd-be29-578a349afb4e None None] MFA Rules not processed for user `427f3ca9698842b594bd2ca32f575013`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:39.582807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a8db01b6-318f-4bfd-be29-578a349afb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:39.604668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:39.662903 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1390/2746] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:39.674704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:39.676201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:39.736071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40f65-7bf5-4e1e-82c0-37800f47b54e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:39.739707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:39.740342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:39.740656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:39.740932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:39.749200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:39.750628 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:39.759360 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1357/2747] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:41.112558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e9c3-2bbd-407f-a2d7-c08a2b175127 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:41.113142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e9c3-2bbd-407f-a2d7-c08a2b175127 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:41.113142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e9c3-2bbd-407f-a2d7-c08a2b175127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:41.131169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4f88e9c3-2bbd-407f-a2d7-c08a2b175127 None None] MFA Rules not processed for user `427f3ca9698842b594bd2ca32f575013`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:54:41.132395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4f88e9c3-2bbd-407f-a2d7-c08a2b175127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:41.139954 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1391/2748] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:54:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:54:42.119354 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:54:42.120821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:42.212813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb9a9-a89e-45eb-af87-10e60979f63e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:54:42.218654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:54:42.219301 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:54:42.219586 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:54:42.219865 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:54:42.221619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:54:42.233777 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:54:42.235439 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58faadb0-fadc-43c3-9cfd-a7699715502f service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:54:42.245592 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1358/2749] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:54:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:54:51.125812 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=22 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:54:52.241223 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=84 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:55:18.500975 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:55:18.501552 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:55:18.501862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:55:18.521887 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] MFA Rules not processed for user `75cc85261ad441f8993877a959bdd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:55:18.523097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:55:18.577858 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1392/2750] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:55:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:55:28.571136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=25 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:12.742286 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:12.742828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:12.742967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:12.760699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] MFA Rules not processed for user `427f3ca9698842b594bd2ca32f575013`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:56:12.761889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:12.768930 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1359/2751] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:56:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:56:12.810306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:12.811713 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:12.888594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497d65e-1bb3-47e2-b0db-fa3d2744b1b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:12.892425 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ec344b4ce9a4de4b55b6425b75da380', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:12.893067 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:12.893351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:12.893630 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:12.895424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:12.976124 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:12.977514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:12.998344 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1393/2752] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:56:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:13.507312 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:13.517120 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75e79c-70d7-4dee-bbfe-eebe27a0a842 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:13.521791 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:13.522080 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:13.522366 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:13.522642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:13.524467 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:13.539107 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:13.540584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aea2b-8773-4779-b5ab-8679d9a91b3b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:13.551847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1360/2753] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:56:22.995711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=72 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:23.546654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:56:53.750269 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:56:53.759952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2729511-9d6d-448c-bf2f-47aa05b8481f service glance] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:56:53.763899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:56:53.764590 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:56:53.764882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:56:53.765165 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:56:53.766951 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:56:53.838169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:56:53.839664 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:56:53.849312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1394/2754] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:56:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:03.844836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=28 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:12.214955 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:12.215583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:12.215583 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:12.236009 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] MFA Rules not processed for user `6f7a1fe832af4c83b4b969729d0721e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:57:12.237284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:12.245832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1361/2755] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:57:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:57:12.568419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:12.577941 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfb479-e4a7-43e1-8cd8-47e0038fe0f7 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:12.581559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:12.582715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:12.583000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:12.583282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:12.585074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:12.596051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:12.597542 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:12.606380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1395/2756] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:13.044151 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:13.056271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddc7c2-8758-46b6-ab2b-9146e4727e8a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:13.061742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:13.062395 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:13.062690 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:13.062972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:13.064807 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:13.078038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:13.079643 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:13.091696 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1362/2757] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:14.912408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:14.921784 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67620b1-a648-43b8-945f-77fdb48486d7 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:14.926128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:14.926913 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:14.927194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:14.927615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:14.929814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:14.942940 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:14.944704 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:14.956623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1396/2758] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:23.087458 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=9 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:24.951911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=12 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:31.993516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:31.995355 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:32.011869 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6dba63-a1d8-450f-91b1-3f3d56b53f5c service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:32.019200 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:32.020570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.021595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.022169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.024245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:32.038707 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:32.040557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:32.053327 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1363/2759] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 16:57:32.150014 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:32.166697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc583492-781f-4e5d-991f-be5ccd578925 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:32.172740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:32.173497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.173688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.174606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.177976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:32.192404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:32.194201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:32.197142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:32.205688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1397/2760] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:32.210723 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144b71ea-0e60-4f69-a771-23a680b23f0d service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:32.215408 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:32.216281 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.216601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.216881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] PATH_INFO: `/v3/users/427f3ca9698842b594bd2ca32f575013` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.218687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=427f3ca9698842b594bd2ca32f575013)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:32.220775 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:32.273549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427f3ca9698842b594bd2ca32f575013'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.274220 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427f3ca9698842b594bd2ca32f575013'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.287473 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427f3ca9698842b594bd2ca32f575013'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.294683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427f3ca9698842b594bd2ca32f575013'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.301674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427f3ca9698842b594bd2ca32f575013'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.307621 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1364/2761] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 16:57:32 2022] DELETE /identity/v3/users/427f3ca9698842b594bd2ca32f575013 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 16:57:32.524992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:32.540814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6556e259-5466-4f0b-8856-534564638f16 service placement] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:32.608534 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:32.609407 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:32.609693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:32.609976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] PATH_INFO: `/v3/projects/40687185a3f94a849d65a09026ea119c` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:32.611170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=40687185a3f94a849d65a09026ea119c)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:32.613108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:32.663545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40687185a3f94a849d65a09026ea119c', 'request_id': 'req-56aaf03b-083e-4483-81ed-7e973de10fbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.671959 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40687185a3f94a849d65a09026ea119c', 'request_id': 'req-56aaf03b-083e-4483-81ed-7e973de10fbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.680170 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40687185a3f94a849d65a09026ea119c', 'request_id': 'req-56aaf03b-083e-4483-81ed-7e973de10fbe'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.690988 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] The token cache is being invalidate because project 40687185a3f94a849d65a09026ea119c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 16:57:32.691280 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.691937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 16:57:32.694071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1398/2762] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 16:57:32 2022] DELETE /identity/v3/projects/40687185a3f94a849d65a09026ea119c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 16:57:35.704076 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:57:35.705534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:35.762967 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd3eac-03a5-4843-bdfe-e2c650b813cc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:57:35.810524 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:57:35.811164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:57:35.811450 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:57:35.811726 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:57:35.813532 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:57:35.842780 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:35.878584 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:57:35.879958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816db536-8fc5-40a1-b41a-7418b4bdc023 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:57:35.890640 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1365/2763] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:57:35 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:57:42.687864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:57:45.886176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=16 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:05.359408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:05.361074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.433831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaf03b-083e-4483-81ed-7e973de10fbe admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:05.439700 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:05.440352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:05.440675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:05.440961 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:05.442783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:05.501696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:05.503886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:05.513775 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1399/2764] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:58:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:15.508859 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=56 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:19.273728 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.274254 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.274347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.292047 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] MFA Rules not processed for user `75cc85261ad441f8993877a959bdd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 16:58:19.293763 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:19.301088 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1366/2765] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 16:58:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 16:58:19.604040 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:58:19.606245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:19.617882 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2dd6-8cc5-40a3-a7b8-4cb4dd57ade5 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:58:19.622167 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:58:19.624659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:58:19.624659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:58:19.624659 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:58:19.625194 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:58:19.635062 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:58:19.636698 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:58:19.644831 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1400/2766] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:58:29.286486 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:58:29.641078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 16:59:53.349464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:53.351545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:53.369713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c6b17-13ba-4332-b882-f7ee4730f57a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:53.375245 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:53.376141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:53.376279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:53.376516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:53.378537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:53.392390 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:53.394185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:53.406335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1367/2767] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:59:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:56.681908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:56.698003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d8ef6-d926-4740-9ce9-c9532c66a597 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:56.703990 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf8a03a9bb9848c0a51808883cb9f929', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:56.705107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:56.705395 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:56.705694 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:56.707798 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:56.721137 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:56.722773 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:56.734086 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1401/2768] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:59:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 16:59:57.265127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 16:59:57.266572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:57.335582 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a1d67-2fab-4575-bd44-63b219c96296 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 16:59:57.340570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 16:59:57.341241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 16:59:57.341529 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 16:59:57.341809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 16:59:57.343610 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 16:59:57.355821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 16:59:57.357448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 16:59:57.368357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1368/2769] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 16:59:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:06.729290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=6 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:07.256614 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:07.266288 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fd290-9af8-494c-b47e-e57c24dc8229 service nova] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:07.269893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:07.270532 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:07.270819 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:07.271103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:07.273383 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:07.336982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:07.338420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:07.348257 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1402/2770] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:00:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:00:07.362984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=38 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:13.856195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:13.858705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:13.883598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8faec5b-7be8-43a1-ab48-f7a97973455f service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:13.889188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:13.889963 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:13.890302 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:13.890605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] PATH_INFO: `/v3/users/6f7a1fe832af4c83b4b969729d0721e9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:13.907261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f7a1fe832af4c83b4b969729d0721e9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:13.909859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:13.985104 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f7a1fe832af4c83b4b969729d0721e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:13.985878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f7a1fe832af4c83b4b969729d0721e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.001662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f7a1fe832af4c83b4b969729d0721e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.011620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f7a1fe832af4c83b4b969729d0721e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.027164 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f7a1fe832af4c83b4b969729d0721e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.034759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1369/2771] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:00:13 2022] DELETE /identity/v3/users/6f7a1fe832af4c83b4b969729d0721e9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:14.226701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:14.238346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea216f4-1dd4-4458-b71a-6b900876d20c service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:14.296658 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:14.297522 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.297807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.298100 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] PATH_INFO: `/v3/projects/257f08cba99b478db51729bf108ec901` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.309026 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=257f08cba99b478db51729bf108ec901)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:14.311064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:14.356434 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257f08cba99b478db51729bf108ec901', 'request_id': 'req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.363566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257f08cba99b478db51729bf108ec901', 'request_id': 'req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.370838 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257f08cba99b478db51729bf108ec901', 'request_id': 'req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.381276 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] The token cache is being invalidate because project 257f08cba99b478db51729bf108ec901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:14.381566 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.382971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.384537 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1403/2772] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:00:14 2022] DELETE /identity/v3/projects/257f08cba99b478db51729bf108ec901 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:14.388480 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:14.389887 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.403419 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616964fa-d26e-41e5-939f-1f6760656796 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:14.465118 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:14.465985 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.466270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.466548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] PATH_INFO: `/v3/users/550df0d2ca204a74a36a634ee5b08e0f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.489906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=550df0d2ca204a74a36a634ee5b08e0f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:14.491953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:14.545038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '550df0d2ca204a74a36a634ee5b08e0f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.545704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '550df0d2ca204a74a36a634ee5b08e0f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.550464 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:14.559754 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '550df0d2ca204a74a36a634ee5b08e0f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.567876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '550df0d2ca204a74a36a634ee5b08e0f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.575477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cae2edae-06dc-430f-a0a3-f8af10ea4f96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '550df0d2ca204a74a36a634ee5b08e0f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.581494 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1370/2773] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:00:14 2022] DELETE /identity/v3/users/550df0d2ca204a74a36a634ee5b08e0f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:14.766118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:00:14.767779 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:14.780950 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de7dc8c-f2e3-4188-b7c8-34f9d5a66ffd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:00:14.793863 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:14.848989 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:00:14.849860 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:14.850142 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:14.850418 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] PATH_INFO: `/v3/projects/284701b4bf6c45e0ad6facc28680c868` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:14.862429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=284701b4bf6c45e0ad6facc28680c868)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:00:14.864207 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:00:14.918721 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284701b4bf6c45e0ad6facc28680c868', 'request_id': 'req-aac20d96-78ca-4c7d-b47c-571f3c118f6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.926307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284701b4bf6c45e0ad6facc28680c868', 'request_id': 'req-aac20d96-78ca-4c7d-b47c-571f3c118f6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.934002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284701b4bf6c45e0ad6facc28680c868', 'request_id': 'req-aac20d96-78ca-4c7d-b47c-571f3c118f6a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.945792 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] The token cache is being invalidate because project 284701b4bf6c45e0ad6facc28680c868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:00:14.946079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.946725 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:00:14.948259 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1404/2774] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:00:14 2022] DELETE /identity/v3/projects/284701b4bf6c45e0ad6facc28680c868 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:00:19.532535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:00:19.533042 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:00:19.533172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:00:19.550589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] MFA Rules not processed for user `75cc85261ad441f8993877a959bdd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:00:19.551786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:00:19.606241 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1371/2775] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:00:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:00:24.942022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:00:29.599642 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=3,keystone:SELECT=35,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:02.305623 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:02.307021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:02.372213 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac20d96-78ca-4c7d-b47c-571f3c118f6a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:02.375787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:02.376457 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:02.376744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:02.377021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:02.378776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:02.449091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:02.450624 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:02.461462 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1405/2776] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:10.327546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:10.329167 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:10.341017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44043553-70d2-4805-a444-d8e9fc88f2ba None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:10.344598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:10.345233 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:10.345521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:10.345804 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:10.347521 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:10.360452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:10.361889 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:10.373209 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1372/2777] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:12.456599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=54 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:20.368421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=6 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:21.073454 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:21.074849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:21.130844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e609b-7a45-4640-93ac-fcb9bdc5b6d7 service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:21.134822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:21.135459 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:21.135747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:21.136022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:21.137804 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:21.198324 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:21.199742 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:21.209038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1406/2778] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:24.012029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.013846 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.029971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e387-924d-41d6-9e87-47784953c182 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.034859 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.035943 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.036232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.036540 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] PATH_INFO: `/v3/users/75cc85261ad441f8993877a959bdd97b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.037821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cc85261ad441f8993877a959bdd97b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.040284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.092487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cc85261ad441f8993877a959bdd97b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.093163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cc85261ad441f8993877a959bdd97b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.106609 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cc85261ad441f8993877a959bdd97b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.114333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cc85261ad441f8993877a959bdd97b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.122109 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-68b8c3c1-a325-4dfb-b49a-bb42ee625d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cc85261ad441f8993877a959bdd97b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.128194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1373/2779] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:24 2022] DELETE /identity/v3/users/75cc85261ad441f8993877a959bdd97b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:24.302689 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.314308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42002da5-c0e7-487b-b586-8219b283a4ea service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.374385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.375236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.375528 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.375807 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] PATH_INFO: `/v3/projects/c56b7ca2b1f54ae782302bead8a35b01` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.377007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56b7ca2b1f54ae782302bead8a35b01)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.378898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.424025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56b7ca2b1f54ae782302bead8a35b01', 'request_id': 'req-e1671d11-13aa-4fb5-abd4-9809c0771816'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.426420 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:24.431782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56b7ca2b1f54ae782302bead8a35b01', 'request_id': 'req-e1671d11-13aa-4fb5-abd4-9809c0771816'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.439393 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56b7ca2b1f54ae782302bead8a35b01', 'request_id': 'req-e1671d11-13aa-4fb5-abd4-9809c0771816'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.450747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] The token cache is being invalidate because project c56b7ca2b1f54ae782302bead8a35b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:24.451039 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.451696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-e1671d11-13aa-4fb5-abd4-9809c0771816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:24.453261 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1407/2780] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:24 2022] DELETE /identity/v3/projects/c56b7ca2b1f54ae782302bead8a35b01 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:24.458326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e294-b601-4643-a305-63e784eed97e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.458627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e294-b601-4643-a305-63e784eed97e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.458936 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52e294-b601-4643-a305-63e784eed97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.477421 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4e52e294-b601-4643-a305-63e784eed97e None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.478627 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e52e294-b601-4643-a305-63e784eed97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.537027 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1374/2781] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:24.544820 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.545123 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.545460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.564075 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.565306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.574000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1408/2782] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:24.578082 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52e294-b601-4643-a305-63e784eed97e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.587622 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52e294-b601-4643-a305-63e784eed97e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.592362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.593050 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.593338 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.593619 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.594350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:24.594686 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.596272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.608263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1375/2783] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:24 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:24.612868 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.623130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb2c3c-85ff-484e-afcb-e8dd32ca6731 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.627902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.628591 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.628881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.629162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.629854 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.631889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.666787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1409/2784] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/projects => generated 370 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:24.670982 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.681498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f78b73-f940-434d-853b-3ff2215c51d4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.739692 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.740358 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.740684 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.740969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.742269 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.744236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.751017 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:24.765944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1376/2785] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:24.770281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.780518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb6a8-7f92-4342-8021-e604a8163cc3 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.785102 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.785751 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.786030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.786308 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.787029 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.789162 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.798877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1410/2786] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:24 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:24.802550 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.813001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f2e59-14a7-4ba8-b9db-79f2f47f8b50 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.817906 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.818803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.819123 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.819407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.820168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.821839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140876d8-e588-4e00-8a36-7ef31ae64902 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.832828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1377/2787] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:24 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:24.836787 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:24.846604 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b1e25-15e9-40ef-9e14-a133638a1f1b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:24.851736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:24.852911 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.853241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.853529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] PATH_INFO: `/v3/projects/c4fead62d3614ba6b1353c89e30a2426/users/321fa7b36bde4b8d923ab0ec663e55a6/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.868766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fead62d3614ba6b1353c89e30a2426, user_id=321fa7b36bde4b8d923ab0ec663e55a6, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:24.871272 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:24.886326 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1411/2788] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:24 2022] PUT /identity/v3/projects/c4fead62d3614ba6b1353c89e30a2426/users/321fa7b36bde4b8d923ab0ec663e55a6/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:24.896598 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:24.896905 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:24.897196 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:24.924863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] MFA Rules not processed for user `321fa7b36bde4b8d923ab0ec663e55a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:24.926097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:24.995272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1378/2789] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:24.999548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.061195 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013284c-5fc4-423d-9cfd-1481b05eba79 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.065895 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.066555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.066840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.067118 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.067800 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.070081 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.094836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1412/2790] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:24 2022] POST /identity/v3/projects => generated 372 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:25.098971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.110219 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe79ed-827a-4987-88c0-2c93b9e4dc43 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.165840 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.166500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.166789 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.167073 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.167764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.169739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.191663 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1379/2791] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:25 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:25.192920 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.203423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba00e9-0dcf-4786-84c8-22151393fa41 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.208530 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.209192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.209484 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.210255 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.210985 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.212615 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.223367 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1413/2792] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:25.228174 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.238299 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd10ebf-3bc6-4b62-a3e8-414ab61934de admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.243310 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.244224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.244556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.244898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] PATH_INFO: `/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd/users/435b56eb63034d05a579a27cd32654c5/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.260767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5a808ba8a743f398f3c1155ea3c2fd, user_id=435b56eb63034d05a579a27cd32654c5, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.263449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.276278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1380/2793] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:25 2022] PUT /identity/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd/users/435b56eb63034d05a579a27cd32654c5/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:25.280190 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.290747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168bf15-25d7-43e5-9f3a-efab66d0c4f7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.330249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:25.347923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.348616 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.348902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.349179 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.349893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.352091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5436008-e45e-4362-837f-ef4973c4c252 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.361743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1414/2794] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:25.365987 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.376248 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76017eca-a5d4-454c-83ba-e24b02052516 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.380839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.381717 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.382003 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.382279 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] PATH_INFO: `/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd/users/435b56eb63034d05a579a27cd32654c5/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.384307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f5a808ba8a743f398f3c1155ea3c2fd, user_id=435b56eb63034d05a579a27cd32654c5, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.386960 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.397124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1381/2795] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:25 2022] PUT /identity/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd/users/435b56eb63034d05a579a27cd32654c5/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:25.408716 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.409022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.409307 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.435869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] MFA Rules not processed for user `435b56eb63034d05a579a27cd32654c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:25.437115 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:25.505472 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1415/2796] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:25.517294 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:25.519038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:25.542749 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:25.579144 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ded16d-b08a-46e1-8c40-51f26bc9ee05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:25.582755 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:25.583391 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:25.583679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:25.583961 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:25.593399 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:25.594827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff89bc4-c289-4c82-bb27-b10897b7f84d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:25.604068 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1382/2797] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:25.959350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.030822 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9fc2be-2d4b-43cd-ad0a-836e8078c3b4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.035446 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.036322 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.036644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.036928 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] PATH_INFO: `/v3/users/321fa7b36bde4b8d923ab0ec663e55a6` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.038778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321fa7b36bde4b8d923ab0ec663e55a6)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.040740 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.086068 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321fa7b36bde4b8d923ab0ec663e55a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.098030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321fa7b36bde4b8d923ab0ec663e55a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.099665 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:26.108057 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321fa7b36bde4b8d923ab0ec663e55a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.108687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321fa7b36bde4b8d923ab0ec663e55a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.109286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321fa7b36bde4b8d923ab0ec663e55a6'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.122387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1416/2798] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:25 2022] DELETE /identity/v3/users/321fa7b36bde4b8d923ab0ec663e55a6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:26.127469 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.127974 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.128127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.145490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:26.146703 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:26.204997 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1383/2799] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:26.215108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.216613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:26.273439 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6e07-fc18-4e3e-8946-c6884b0ec127 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.277217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.278380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.278380 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.278603 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.287578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.289683 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.299052 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1417/2800] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:26.565839 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.567275 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:26.580103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aeb883-89b6-4afe-b810-6a25d0036820 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.584750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.586266 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.586969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.586969 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] PATH_INFO: `/v3/projects/c4fead62d3614ba6b1353c89e30a2426` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.587995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fead62d3614ba6b1353c89e30a2426)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.590025 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.639225 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fead62d3614ba6b1353c89e30a2426', 'request_id': 'req-f5d23df1-41b6-4b2d-88a3-420d924b83e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.644772 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fead62d3614ba6b1353c89e30a2426', 'request_id': 'req-f5d23df1-41b6-4b2d-88a3-420d924b83e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.653055 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fead62d3614ba6b1353c89e30a2426', 'request_id': 'req-f5d23df1-41b6-4b2d-88a3-420d924b83e9'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.663968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] The token cache is being invalidate because project c4fead62d3614ba6b1353c89e30a2426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:26.664258 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.664898 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.666441 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1384/2801] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:26 2022] DELETE /identity/v3/projects/c4fead62d3614ba6b1353c89e30a2426 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:26.670554 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:26.680642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39db987-bc8d-4ca6-b644-bfe6d88723e6 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:26.736578 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:26.737471 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:26.737760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:26.738041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] PATH_INFO: `/v3/users/435b56eb63034d05a579a27cd32654c5` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:26.739223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=435b56eb63034d05a579a27cd32654c5)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:26.741178 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:26.785149 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435b56eb63034d05a579a27cd32654c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.797428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435b56eb63034d05a579a27cd32654c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.804504 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435b56eb63034d05a579a27cd32654c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.805108 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435b56eb63034d05a579a27cd32654c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.805695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-292e96a9-0398-4569-9fe4-2acb9fa1e75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435b56eb63034d05a579a27cd32654c5'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:26.817896 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1418/2802] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:26 2022] DELETE /identity/v3/users/435b56eb63034d05a579a27cd32654c5 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:27.349572 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.351231 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:27.366221 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d23df1-41b6-4b2d-88a3-420d924b83e9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.410702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:27.424654 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.425516 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.425805 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.426084 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] PATH_INFO: `/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.427346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f5a808ba8a743f398f3c1155ea3c2fd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.429901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.475101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f5a808ba8a743f398f3c1155ea3c2fd', 'request_id': 'req-5f342a2f-b041-4a61-acc5-c0aec48dba0d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:27.480533 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f5a808ba8a743f398f3c1155ea3c2fd', 'request_id': 'req-5f342a2f-b041-4a61-acc5-c0aec48dba0d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:27.487482 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f5a808ba8a743f398f3c1155ea3c2fd', 'request_id': 'req-5f342a2f-b041-4a61-acc5-c0aec48dba0d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:27.499303 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] The token cache is being invalidate because project 1f5a808ba8a743f398f3c1155ea3c2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:27.499595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:27.500270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5f342a2f-b041-4a61-acc5-c0aec48dba0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:27.501837 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1385/2803] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:27 2022] DELETE /identity/v3/projects/1f5a808ba8a743f398f3c1155ea3c2fd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:27.507774 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.508070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.508394 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.515581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:27.527548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:27.528877 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:27.587131 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1419/2804] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:27.594797 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.595097 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.595383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.613569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:27.614764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:27.623203 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1386/2805] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:27.627284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.637606 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0fe2f-f5b9-4cd8-9593-b8f0b3e730e4 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.642221 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.642871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.643158 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.643438 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.644166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:27.644518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.646121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.657611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1420/2806] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:27 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:27.661770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.671405 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eac92-a233-4738-b48a-c9abaff95057 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.676146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.676834 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.677127 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.677413 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.678146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.680589 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.707348 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1387/2807] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:27 2022] POST /identity/v3/projects => generated 366 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:27.711518 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.721436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6dfaf-7fd0-40fa-a6aa-aba7262e4832 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.777215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.777883 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.778175 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.778460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.779159 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.781121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.802602 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1421/2808] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:27 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:27.806114 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.816287 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b41126-eefc-4cc0-a2f7-71afe8b8963a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.821418 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.822103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.822416 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.822693 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.823470 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.825128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.835507 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1388/2809] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:27 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:27.839290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.849130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840c94f-97b0-4922-b101-933a9ed5ef24 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.854281 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.854937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.855237 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.855569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.856216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.857815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d96ff-14ca-42c0-ac95-f366bcbb9949 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.868230 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1422/2810] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:27 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:27.872226 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:27.882108 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b04c7-1c24-4de2-9f72-9c7a71f5b92c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:27.886940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:27.887854 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.888145 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.888460 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] PATH_INFO: `/v3/projects/ad239b471e534f0cbb7e8975a3255e59/users/9ac51bcd18774612b5042c96ef0db693/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.902976 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad239b471e534f0cbb7e8975a3255e59, user_id=9ac51bcd18774612b5042c96ef0db693, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:27.905679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:27.918748 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1389/2811] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:27 2022] PUT /identity/v3/projects/ad239b471e534f0cbb7e8975a3255e59/users/9ac51bcd18774612b5042c96ef0db693/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:27.930205 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:27.930533 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:27.930815 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:27.957248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] MFA Rules not processed for user `9ac51bcd18774612b5042c96ef0db693`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:27.958470 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:28.023283 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:28.027315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1423/2812] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:28.031860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.093041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2263a87-befb-4b6f-bdf1-0885f6ed2223 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.097647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.098290 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.098575 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.098857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.099535 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.101996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.120430 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:28.128518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1390/2813] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:28 2022] POST /identity/v3/projects => generated 364 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:28.133435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.143999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d270b3-8386-4d10-bbc5-7a2cf0ade4b7 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.199093 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.199879 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.200163 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.200468 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.201154 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.203087 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.224041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1424/2814] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:28 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:28.228844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.239096 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e8340-146c-462c-a171-8e8e8e1ecb49 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.243719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.244394 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.244701 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.244984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.245713 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.247313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.258029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1391/2815] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:28 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:28.262027 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.271736 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b45b4f-1a1a-4ec6-ae06-c8e2f5305863 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.277132 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.278078 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.278329 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.278611 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] PATH_INFO: `/v3/projects/ca3e503d7fdf46759968b45f089b2ea8/users/9135654b8b204b04a9db6b4691c07e95/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.295041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3e503d7fdf46759968b45f089b2ea8, user_id=9135654b8b204b04a9db6b4691c07e95, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.297748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.314092 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1425/2816] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:28 2022] PUT /identity/v3/projects/ca3e503d7fdf46759968b45f089b2ea8/users/9135654b8b204b04a9db6b4691c07e95/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:28.317972 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.329141 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a874e-7f2b-4a1c-83f9-9caa85ce0460 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.386222 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.386944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.387232 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.387512 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.388234 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.389888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2f8c4-0461-4897-8ba9-7442057b31ec admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.399490 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1392/2817] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:28 2022] GET /identity/v3/roles => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:28.403660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.414091 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80d178-481c-4c36-b9ae-7fd839a66588 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.418711 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.419589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.419876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.420168 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] PATH_INFO: `/v3/projects/ca3e503d7fdf46759968b45f089b2ea8/users/9135654b8b204b04a9db6b4691c07e95/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.422192 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3e503d7fdf46759968b45f089b2ea8, user_id=9135654b8b204b04a9db6b4691c07e95, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.424898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.435719 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1426/2818] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:28 2022] PUT /identity/v3/projects/ca3e503d7fdf46759968b45f089b2ea8/users/9135654b8b204b04a9db6b4691c07e95/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:28.446377 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.446674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.446957 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.473365 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] MFA Rules not processed for user `9135654b8b204b04a9db6b4691c07e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:28.474546 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:28.541103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1393/2819] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:28.552017 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.554342 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:28.611210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1bd0-f40c-4653-8a6b-3b3fa77af544 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.614889 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.615555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.615843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.616797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.625776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.627222 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.636574 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1427/2820] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:28.709994 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:28.719629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecf349-ee41-4afc-b52e-d55b91b2841f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:28.723288 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:28.723900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:28.724186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:28.724497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:28.781307 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:28.782762 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd57df-0285-44f0-97e7-0b2f53193d21 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:28.792498 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1394/2821] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:38.632398 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=70,keystone:INSERT=5 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:38.787503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:39.966929 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.028847 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924418f-0d6e-43f9-ba35-ddfb42c8cf6f service cinder] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.033388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.034287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.034575 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.034855 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] PATH_INFO: `/v3/users/9ac51bcd18774612b5042c96ef0db693` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.036045 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac51bcd18774612b5042c96ef0db693)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.037992 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.083025 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac51bcd18774612b5042c96ef0db693'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.095392 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac51bcd18774612b5042c96ef0db693'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.102226 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac51bcd18774612b5042c96ef0db693'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.103007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac51bcd18774612b5042c96ef0db693'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.103618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac51bcd18774612b5042c96ef0db693'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.115696 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1428/2822] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:39 2022] DELETE /identity/v3/users/9ac51bcd18774612b5042c96ef0db693 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:40.120741 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.121342 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.121613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.139465 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:40.141015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:40.199176 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1395/2823] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:40.208886 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.210247 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:40.266589 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a669-3ac4-4946-b2f6-78f5f5d14369 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.270290 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.270937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.271228 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.271511 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.280424 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.281862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.291351 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1429/2824] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:40.549597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.551240 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:40.565571 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0e90f-9683-4c97-a889-77c0d54e1dd3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.571016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.571882 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.572193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.572518 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] PATH_INFO: `/v3/projects/ad239b471e534f0cbb7e8975a3255e59` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.573725 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad239b471e534f0cbb7e8975a3255e59)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.575715 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.627282 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad239b471e534f0cbb7e8975a3255e59', 'request_id': 'req-313c3185-9866-484c-a69a-efb3429f72e7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.632718 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad239b471e534f0cbb7e8975a3255e59', 'request_id': 'req-313c3185-9866-484c-a69a-efb3429f72e7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.639739 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad239b471e534f0cbb7e8975a3255e59', 'request_id': 'req-313c3185-9866-484c-a69a-efb3429f72e7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.650493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] The token cache is being invalidate because project ad239b471e534f0cbb7e8975a3255e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:40.650785 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.651411 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.652981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1396/2825] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:40 2022] DELETE /identity/v3/projects/ad239b471e534f0cbb7e8975a3255e59 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:40.657169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:40.667286 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a19cb-7e40-4ac0-a5d2-44a7773e3681 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:40.685766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:40.724915 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:40.725712 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:40.726003 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:40.726287 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] PATH_INFO: `/v3/users/9135654b8b204b04a9db6b4691c07e95` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:40.727993 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9135654b8b204b04a9db6b4691c07e95)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:40.729937 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:40.775600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9135654b8b204b04a9db6b4691c07e95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.787715 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9135654b8b204b04a9db6b4691c07e95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.795806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9135654b8b204b04a9db6b4691c07e95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.796433 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9135654b8b204b04a9db6b4691c07e95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.797034 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-f12279c4-53b4-4c5e-80a1-e707530c11d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9135654b8b204b04a9db6b4691c07e95'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:40.809783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1430/2826] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:40 2022] DELETE /identity/v3/users/9135654b8b204b04a9db6b4691c07e95 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:41.075156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.077984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.124682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c3185-9866-484c-a69a-efb3429f72e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.174224 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:41.182247 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.183143 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.183599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.184066 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] PATH_INFO: `/v3/projects/ca3e503d7fdf46759968b45f089b2ea8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.185442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3e503d7fdf46759968b45f089b2ea8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.187345 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.233912 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3e503d7fdf46759968b45f089b2ea8', 'request_id': 'req-83746f9c-8b78-41f7-8008-753ccc00d3fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.239364 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3e503d7fdf46759968b45f089b2ea8', 'request_id': 'req-83746f9c-8b78-41f7-8008-753ccc00d3fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.246645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3e503d7fdf46759968b45f089b2ea8', 'request_id': 'req-83746f9c-8b78-41f7-8008-753ccc00d3fd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.257577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] The token cache is being invalidate because project ca3e503d7fdf46759968b45f089b2ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:41.257806 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.258414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83746f9c-8b78-41f7-8008-753ccc00d3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:41.260503 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1397/2827] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:41 2022] DELETE /identity/v3/projects/ca3e503d7fdf46759968b45f089b2ea8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:41.265509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.266005 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.266126 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.284339 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:41.285553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.344450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1431/2828] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:41.352179 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.352574 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.352888 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.370682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:41.371880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.379877 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1398/2829] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:41.384499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.394023 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5083fe-3e4a-4c23-afbb-612775f42665 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.398642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.399893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.400183 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.400501 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.401235 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:41.401550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.403151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.414499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1432/2830] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:41.418620 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.428170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1be0a-1f3b-4596-9629-da1f1f7c65b2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.432970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.433623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.433913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.434193 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.434891 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.436876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.463192 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1399/2831] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/projects => generated 388 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:41.467593 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.477588 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a71a-c0d0-4340-8422-de37eafd8398 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.502754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:41.534739 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.535331 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.535620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.535900 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.536610 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.538509 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.558556 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1433/2832] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:41.562874 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.573848 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eecb8d-a955-4a52-8400-91249a67f847 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.578515 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.579163 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.579448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.579724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.580481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.582074 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.592944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1400/2833] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:41.596862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.607744 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fcea58-982d-4dae-9ec1-6262b0130e7c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.612448 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.613109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.613396 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.613676 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.614428 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.616021 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03731bf-926e-4d9b-acd9-54708a98c365 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.626829 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1434/2834] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:41.630868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.641261 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf41c6-b48a-4568-86de-f192d68ed52c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.645793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.646665 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.646944 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.647215 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] PATH_INFO: `/v3/projects/769928770d114c02ba5cd9457567a62e/users/0d48a4f63f544dc69d3164d9cf41d4a7/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.661382 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=769928770d114c02ba5cd9457567a62e, user_id=0d48a4f63f544dc69d3164d9cf41d4a7, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.664019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.676466 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1401/2835] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:41 2022] PUT /identity/v3/projects/769928770d114c02ba5cd9457567a62e/users/0d48a4f63f544dc69d3164d9cf41d4a7/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:41.688042 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.688345 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.688695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.715116 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] MFA Rules not processed for user `0d48a4f63f544dc69d3164d9cf41d4a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:41.716318 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:41.780284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1435/2836] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:41.785092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.847372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197f146-4521-4a7c-b7ee-902bb3c19186 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.852019 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.852724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.853016 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.853295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.853979 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.856012 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.880950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1402/2837] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/projects => generated 386 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:41.885673 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.896201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f499986-a816-4485-9912-1d2b4198e901 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.952134 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.952881 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.953169 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.953449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.954153 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.956090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:41.975697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1436/2838] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:41 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:41.979945 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:41.990154 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27e1b6-f39d-4990-b4b5-82eb271fbf0d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:41.995335 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:41.995984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:41.996278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:41.996590 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:41.997318 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:41.998913 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.000128 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:42.011788 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1403/2839] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:41 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:42.015902 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.025690 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3fcb9-bff4-4d71-810b-b641f13d2410 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.030138 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.031028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.031311 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.031586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] PATH_INFO: `/v3/projects/920a63f8663f4769a7a4855abaea9368/users/80aa6e7cace4460db1e97a62d46b3375/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.048449 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920a63f8663f4769a7a4855abaea9368, user_id=80aa6e7cace4460db1e97a62d46b3375, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.051082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.064818 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1437/2840] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:42 2022] PUT /identity/v3/projects/920a63f8663f4769a7a4855abaea9368/users/80aa6e7cace4460db1e97a62d46b3375/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:42.068842 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.078965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c92cff-c4fd-4c78-9c15-974ff3882129 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.134357 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.135081 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.135296 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.135577 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.136304 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.137949 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b797d45-4fd6-49af-8cfa-c8fc9e0c1c59 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.147578 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1404/2841] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:42 2022] GET /identity/v3/roles => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:42.151723 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.157196 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:42.163668 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b946dd6-b934-4726-9831-f99b63eac390 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.169104 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.169979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.170266 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.170545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] PATH_INFO: `/v3/projects/920a63f8663f4769a7a4855abaea9368/users/80aa6e7cace4460db1e97a62d46b3375/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.172594 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=920a63f8663f4769a7a4855abaea9368, user_id=80aa6e7cace4460db1e97a62d46b3375, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.175217 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.186174 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1438/2842] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:42 2022] PUT /identity/v3/projects/920a63f8663f4769a7a4855abaea9368/users/80aa6e7cace4460db1e97a62d46b3375/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:42.196444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.196742 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.197029 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.223372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] MFA Rules not processed for user `80aa6e7cace4460db1e97a62d46b3375`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:42.224604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:42.292591 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1405/2843] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:42.303613 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.305291 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:42.378601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0661d-8a10-4015-80c7-007a32da2335 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.382298 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.382939 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.383229 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.383514 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.392435 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.393865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17968ccd-a640-430e-8c13-7b2d826d3b85 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.403796 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1439/2844] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:42.468078 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.531077 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fcbcc-62f9-49cc-9083-74ed6156c1a6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.535767 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.536688 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.536989 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.537265 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] PATH_INFO: `/v3/users/0d48a4f63f544dc69d3164d9cf41d4a7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.538489 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d48a4f63f544dc69d3164d9cf41d4a7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.541106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.561845 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:42.587272 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d48a4f63f544dc69d3164d9cf41d4a7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:42.587921 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d48a4f63f544dc69d3164d9cf41d4a7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:42.599593 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d48a4f63f544dc69d3164d9cf41d4a7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:42.606773 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d48a4f63f544dc69d3164d9cf41d4a7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:42.613734 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d48a4f63f544dc69d3164d9cf41d4a7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:42.620092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1406/2845] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:42 2022] DELETE /identity/v3/users/0d48a4f63f544dc69d3164d9cf41d4a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:42.624869 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.625166 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.625451 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.642873 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:42.644097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:42.701597 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1440/2846] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:42.711170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:42.712614 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:42.790916 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19f439-6d51-457b-814c-55f22e52f29f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:42.794639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:42.795278 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:42.795570 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:42.795853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:42.810519 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:42.812040 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:42.821768 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1407/2847] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 17:02:43.077094 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.078531 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.094074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477c0603-118d-47bf-b4ac-67ded9b581e8 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.098968 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.099876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.100215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.100536 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] PATH_INFO: `/v3/projects/769928770d114c02ba5cd9457567a62e` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.101770 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=769928770d114c02ba5cd9457567a62e)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.104236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.153146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '769928770d114c02ba5cd9457567a62e', 'request_id': 'req-100366b2-7a8d-4468-9fe2-5939ede490c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.160330 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '769928770d114c02ba5cd9457567a62e', 'request_id': 'req-100366b2-7a8d-4468-9fe2-5939ede490c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.167493 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '769928770d114c02ba5cd9457567a62e', 'request_id': 'req-100366b2-7a8d-4468-9fe2-5939ede490c7'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.174450 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:43.179051 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] The token cache is being invalidate because project 769928770d114c02ba5cd9457567a62e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:43.179352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.180245 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.182453 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1441/2848] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:43 2022] DELETE /identity/v3/projects/769928770d114c02ba5cd9457567a62e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:43.186477 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.196313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa2c79-017a-4f4c-a02d-a92b292df118 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.252436 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.253305 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.253596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.253880 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] PATH_INFO: `/v3/users/80aa6e7cace4460db1e97a62d46b3375` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.255070 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] RBAC: Authorizing `identity:delete_user(user_id=80aa6e7cace4460db1e97a62d46b3375)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.257045 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.278724 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:43.303758 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80aa6e7cace4460db1e97a62d46b3375'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.304420 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80aa6e7cace4460db1e97a62d46b3375'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.317277 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80aa6e7cace4460db1e97a62d46b3375'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.325497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80aa6e7cace4460db1e97a62d46b3375'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.332173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5ead839a-0c7c-4ffb-99b5-009636e7cdec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80aa6e7cace4460db1e97a62d46b3375'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.338463 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1408/2849] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:43 2022] DELETE /identity/v3/users/80aa6e7cace4460db1e97a62d46b3375 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:43.612242 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.613737 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.626823 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100366b2-7a8d-4468-9fe2-5939ede490c7 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.682583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.683442 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.683803 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.684157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] PATH_INFO: `/v3/projects/920a63f8663f4769a7a4855abaea9368` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.685360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] RBAC: Authorizing `identity:delete_project(project_id=920a63f8663f4769a7a4855abaea9368)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.687241 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.731755 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920a63f8663f4769a7a4855abaea9368', 'request_id': 'req-b59f999b-f777-4d76-8adf-d705cd35254d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.738049 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920a63f8663f4769a7a4855abaea9368', 'request_id': 'req-b59f999b-f777-4d76-8adf-d705cd35254d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.744136 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920a63f8663f4769a7a4855abaea9368', 'request_id': 'req-b59f999b-f777-4d76-8adf-d705cd35254d'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.754105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] The token cache is being invalidate because project 920a63f8663f4769a7a4855abaea9368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:43.754387 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.754995 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-b59f999b-f777-4d76-8adf-d705cd35254d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:43.756545 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1442/2850] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:43 2022] DELETE /identity/v3/projects/920a63f8663f4769a7a4855abaea9368 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:43.762867 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.763188 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.763472 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.782153 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:43.783361 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.844195 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1409/2851] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:43.851952 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.852337 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.852662 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.871233 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:43.872348 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:43.880151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1443/2852] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:43.884958 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.894623 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537c901-d826-4646-8f8a-5e6c404f2bdc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.899216 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.899856 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.900139 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.900449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.901172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:43.901479 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.903173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.914343 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1410/2853] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:43.918513 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.927553 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275f12f-a4c5-4eb7-bb7e-ade4fdf1011a None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:43.932653 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:43.933295 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:43.933581 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:43.933857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:43.934546 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:43.936460 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:43.962789 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1444/2854] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/projects => generated 378 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:43.967110 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:43.976799 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534edfe1-4386-4bb8-a255-c1117f87ae3b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.031910 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.032597 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.032881 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.033157 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.033832 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.035746 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.054714 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1411/2855] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:43 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:44.059469 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.069984 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb3229-001f-4d2d-8adc-426b9ce7169c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.075200 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.075849 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.076173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.076492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.077218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.078814 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.089082 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1445/2856] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:44.093071 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.102901 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f856c5-7f13-4454-a467-c22f5e6082f8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.107504 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.108150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.108462 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.108738 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.109461 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.111041 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479556e-39df-43b4-86c6-e033ae023a7a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.121613 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1412/2857] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/roles => generated 1427 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:44.126271 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.136781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f169e1a-1055-4ac1-b2bf-8d8d00fdd2bd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.141691 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.142569 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.142874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.143157 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] PATH_INFO: `/v3/projects/ff6c04b83db948f9b5d731f9513e8e5f/users/41ec73245ec1473696507f01db535b09/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.157708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6c04b83db948f9b5d731f9513e8e5f, user_id=41ec73245ec1473696507f01db535b09, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.160419 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.173908 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1446/2858] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:44 2022] PUT /identity/v3/projects/ff6c04b83db948f9b5d731f9513e8e5f/users/41ec73245ec1473696507f01db535b09/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:44.185531 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.185844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.186132 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.192931 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:44.214604 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] MFA Rules not processed for user `41ec73245ec1473696507f01db535b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:44.215844 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:44.278674 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1413/2859] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:44.282833 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.314384 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:44.345921 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1fe8-cfeb-46f8-a7d4-52736a7e91a4 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.350555 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.351210 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.351497 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.351777 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.353013 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.354923 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.379607 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1447/2860] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/projects => generated 380 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:44.384311 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.394841 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6da9b7-7935-490a-baff-5516786ea7f4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.450873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.451534 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.451821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.452100 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.452829 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.454752 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.483455 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1414/2861] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:44.487440 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.521663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b45def-cba5-4a2f-af9b-0ab63c5e384e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.526862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.527517 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.527811 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.528090 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.528843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.530436 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.540236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1448/2862] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/roles => generated 1427 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:44.544236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.579539 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c8fef-4476-445b-b965-436d25a16d1c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.584201 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.584883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.585169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.585448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.586162 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.588429 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26df2c5-84dd-46c4-8272-c5a7002f2b71 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.598295 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1415/2863] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/roles => generated 1427 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:44.602349 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.612173 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2fc08-cb80-4ca9-8846-052c0868ef8d admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.616720 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.617586 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.618368 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.618644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] PATH_INFO: `/v3/projects/8cfa6af74b75440691f89884871e4aef/users/b20eacc7b49d4761a92e2ea537a3dcfd/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.634408 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfa6af74b75440691f89884871e4aef, user_id=b20eacc7b49d4761a92e2ea537a3dcfd, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.637060 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.649558 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1449/2864] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:44 2022] PUT /identity/v3/projects/8cfa6af74b75440691f89884871e4aef/users/b20eacc7b49d4761a92e2ea537a3dcfd/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:44.659607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.659902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.660214 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.686678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] MFA Rules not processed for user `b20eacc7b49d4761a92e2ea537a3dcfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:44.687875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:44.717505 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:44.754407 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1416/2865] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:44.759596 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.820079 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8ffa71-6f5c-4b47-84d9-6b4e40b880a8 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.825473 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.826128 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.826416 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.826697 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.827388 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.830119 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.856898 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1450/2866] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/projects => generated 378 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:44.860971 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.872682 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00159bc1-bc18-4492-b458-f25a58f82c5c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.928069 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.928704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.928996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.929280 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.929981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.932447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.952431 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1417/2867] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:44 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:44.956430 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:44.966916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f745a8-16a1-46fd-93fc-1835bc8a3f86 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:44.971644 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:44.972302 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:44.972642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:44.972926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:44.973656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:44.975258 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:44.986182 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1451/2868] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:44 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:44.990101 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.000410 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05321f4-51c4-4f4e-8938-a510363a800e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.005030 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.005902 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.006194 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.006481 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] PATH_INFO: `/v3/projects/0d68bfed924f47bd8b00b601787af47b/users/954c8e34bc104a2cbf30c80226433ecb/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.021530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d68bfed924f47bd8b00b601787af47b, user_id=954c8e34bc104a2cbf30c80226433ecb, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.024230 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.037346 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1418/2869] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:44 2022] PUT /identity/v3/projects/0d68bfed924f47bd8b00b601787af47b/users/954c8e34bc104a2cbf30c80226433ecb/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:45.041857 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.051760 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50d4ac-8d47-4022-bd31-e9ff5c5567bd admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.076074 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:45.109682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.110350 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.110642 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.110924 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.111648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.113315 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3449d33-cbf7-4d7b-8f09-920e5a700612 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.124747 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1452/2870] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:45 2022] GET /identity/v3/roles => generated 1427 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:45.129124 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.139308 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e612f9-9fb6-4d32-9d94-4c799ca05911 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.143793 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.144699 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.144981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.145252 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] PATH_INFO: `/v3/projects/0d68bfed924f47bd8b00b601787af47b/users/954c8e34bc104a2cbf30c80226433ecb/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.147181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d68bfed924f47bd8b00b601787af47b, user_id=954c8e34bc104a2cbf30c80226433ecb, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.149857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.159790 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1419/2871] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:45 2022] PUT /identity/v3/projects/0d68bfed924f47bd8b00b601787af47b/users/954c8e34bc104a2cbf30c80226433ecb/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:45.222748 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.222953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.223239 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.250978 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] MFA Rules not processed for user `954c8e34bc104a2cbf30c80226433ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:45.252201 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.321378 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1453/2872] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:45.332548 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.334315 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.391849 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f890de-34b7-44da-bfac-b1b6b4ca85c0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.395530 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.396168 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.396500 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.396786 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.406213 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.407657 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.417601 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1420/2873] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:45.459423 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:45.460852 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:45.473708 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abe3f2-752d-4617-a940-be4bf9666aaf None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:45.478781 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:45.479429 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:45.479717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:45.479999 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:45.534871 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:45.536312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bd08af-6ae9-4bfa-89e9-ca3631ccebe7 service cinder] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:45.545743 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1454/2874] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:48.378083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:48.405362 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:48.440719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb7ca-843b-4081-b2ed-c608af8956b1 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:48.445557 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:48.446415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.446702 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.446980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] PATH_INFO: `/v3/users/41ec73245ec1473696507f01db535b09` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.448182 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ec73245ec1473696507f01db535b09)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:48.450160 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:48.496116 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ec73245ec1473696507f01db535b09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.496866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ec73245ec1473696507f01db535b09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.509062 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ec73245ec1473696507f01db535b09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.516863 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ec73245ec1473696507f01db535b09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.523824 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ec73245ec1473696507f01db535b09'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:48.530380 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1421/2875] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:48 2022] DELETE /identity/v3/users/41ec73245ec1473696507f01db535b09 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:48.535028 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.535503 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.535608 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.562243 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:48.563371 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:48.596963 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=100 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:48.622366 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1455/2876] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:48.631996 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:48.633449 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:48.689759 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c28c-b86a-4caa-9e41-32db416c539b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:48.693359 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:48.694244 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.694542 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.694823 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.704158 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:48.705625 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:48.715452 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1422/2877] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:48.978009 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:48.979492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:48.992172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5168383-020c-495d-b419-2db1ebd2c995 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:48.996821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:48.997688 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:48.998022 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:48.998306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] PATH_INFO: `/v3/projects/ff6c04b83db948f9b5d731f9513e8e5f` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:48.999499 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6c04b83db948f9b5d731f9513e8e5f)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.001564 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.048884 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6c04b83db948f9b5d731f9513e8e5f', 'request_id': 'req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.055956 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6c04b83db948f9b5d731f9513e8e5f', 'request_id': 'req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.062874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6c04b83db948f9b5d731f9513e8e5f', 'request_id': 'req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.074360 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] The token cache is being invalidate because project ff6c04b83db948f9b5d731f9513e8e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:49.074649 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.075282 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.076844 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1456/2878] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:48 2022] DELETE /identity/v3/projects/ff6c04b83db948f9b5d731f9513e8e5f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:49.080822 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:49.090326 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056d5c0-3cbd-4a1a-a427-9cf89808fc4f service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:49.133803 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:49.148173 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:49.149103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.149392 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.149668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] PATH_INFO: `/v3/users/b20eacc7b49d4761a92e2ea537a3dcfd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.150868 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20eacc7b49d4761a92e2ea537a3dcfd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.152860 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.200968 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20eacc7b49d4761a92e2ea537a3dcfd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.201647 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20eacc7b49d4761a92e2ea537a3dcfd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.214747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20eacc7b49d4761a92e2ea537a3dcfd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.222556 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20eacc7b49d4761a92e2ea537a3dcfd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.229691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20eacc7b49d4761a92e2ea537a3dcfd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.235596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1423/2879] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:49 2022] DELETE /identity/v3/users/b20eacc7b49d4761a92e2ea537a3dcfd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:49.509600 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:49.511130 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:49.526806 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542d1d2-7e4d-4ee7-8315-d2b6661d0a10 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:49.586000 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:49.586865 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.587151 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.587431 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] PATH_INFO: `/v3/projects/8cfa6af74b75440691f89884871e4aef` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.588632 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfa6af74b75440691f89884871e4aef)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.590529 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.636041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfa6af74b75440691f89884871e4aef', 'request_id': 'req-74acd995-24a0-44e0-9b76-480dd9d6659a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.642912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfa6af74b75440691f89884871e4aef', 'request_id': 'req-74acd995-24a0-44e0-9b76-480dd9d6659a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.648957 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfa6af74b75440691f89884871e4aef', 'request_id': 'req-74acd995-24a0-44e0-9b76-480dd9d6659a'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.652926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:49.661007 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] The token cache is being invalidate because project 8cfa6af74b75440691f89884871e4aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:49.661301 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.662041 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.663876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1457/2880] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:49 2022] DELETE /identity/v3/projects/8cfa6af74b75440691f89884871e4aef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:49.668414 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:49.669813 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:49.683353 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54098c-8983-4ab1-b07f-cfc97fd76974 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:49.741333 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:49.742206 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:49.742493 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:49.742774 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] PATH_INFO: `/v3/users/954c8e34bc104a2cbf30c80226433ecb` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:49.743948 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=954c8e34bc104a2cbf30c80226433ecb)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:49.746497 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:49.790015 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954c8e34bc104a2cbf30c80226433ecb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.790747 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954c8e34bc104a2cbf30c80226433ecb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.802838 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954c8e34bc104a2cbf30c80226433ecb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.805284 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:49.810783 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954c8e34bc104a2cbf30c80226433ecb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.818658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4532a631-b8a8-4ebc-a872-2d6ce56cb23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954c8e34bc104a2cbf30c80226433ecb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:49.824926 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1424/2881] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:49 2022] DELETE /identity/v3/users/954c8e34bc104a2cbf30c80226433ecb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 17:02:50.090979 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.092592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.105766 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acd995-24a0-44e0-9b76-480dd9d6659a admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.164492 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.165357 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.165648 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.165936 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] PATH_INFO: `/v3/projects/0d68bfed924f47bd8b00b601787af47b` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.167660 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d68bfed924f47bd8b00b601787af47b)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.169601 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.215768 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d68bfed924f47bd8b00b601787af47b', 'request_id': 'req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:50.223085 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d68bfed924f47bd8b00b601787af47b', 'request_id': 'req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:50.229218 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d68bfed924f47bd8b00b601787af47b', 'request_id': 'req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:50.239862 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] The token cache is being invalidate because project 0d68bfed924f47bd8b00b601787af47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80289) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:50.240146 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:50.240797 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-07f42cdd-4dce-47f0-a0ee-6278d0944fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:50.242306 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1458/2882] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:50 2022] DELETE /identity/v3/projects/0d68bfed924f47bd8b00b601787af47b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:50.249022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.249320 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.249606 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.267596 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.268836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.328545 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1425/2883] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.336827 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.337121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.337404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.355647 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.356876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.364618 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1459/2884] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:50.368635 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.378866 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53017950-edfc-4589-bdcd-5b7b915c9219 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.383569 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.384217 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.384553 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.384843 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.385602 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:50.385975 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.387580 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.399322 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1426/2885] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:50.403595 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.412717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ab3a5-2b1d-4bab-97cf-5070903135e0 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.417916 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.418502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.418790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.419071 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.419776 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.421693 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.447358 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1460/2886] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/projects => generated 374 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 17:02:50.451091 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.460871 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af45b-23a3-4b80-bd81-120ae903c6ee admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.517444 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.518103 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.518396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.518683 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.519387 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.521372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.541451 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1427/2887] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:50.545220 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.555502 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bfa651-0471-4bc3-be29-9cff6e80fe48 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.560821 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.561481 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.561769 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.562054 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.562782 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.564447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.575312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1461/2888] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 17:02:50.579409 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.590491 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8d6d2-64d5-4cab-afcb-aa25b752dd2e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.594853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.595607 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.595904 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.596186 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.596953 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.598561 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8801a-2018-4656-9522-13a8ab53fbf4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.609242 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1428/2889] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:50.613506 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.623426 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874ca6e-72d9-4903-90f6-bb88e5fb6c6b admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.628164 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.629070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.629362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.629645 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] PATH_INFO: `/v3/projects/4d164aed8338482f9706cc21a8653c9f/users/39bdced423af4c1790f259f7f53aa915/roles/43b33b457be34a02b9be138701888988` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.643856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d164aed8338482f9706cc21a8653c9f, user_id=39bdced423af4c1790f259f7f53aa915, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.646523 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.659783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1462/2890] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:50 2022] PUT /identity/v3/projects/4d164aed8338482f9706cc21a8653c9f/users/39bdced423af4c1790f259f7f53aa915/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:50.671897 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.672634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.672634 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.701645 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] MFA Rules not processed for user `39bdced423af4c1790f259f7f53aa915`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:50.702853 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:50.745585 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:50.771980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1429/2891] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 17:02:50.777249 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.800038 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:50.843284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ee4bdb-b611-4f21-8919-711f5150a733 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.848105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.848874 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.849231 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.849583 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.850361 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.852346 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.879735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1463/2892] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/projects => generated 374 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:50.884142 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.896629 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a4bfc-7fc6-48c6-8297-429b5fd06683 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.955181 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.955765 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.956054 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.956383 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:50.957092 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:50.959034 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:50.978064 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1430/2893] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:50 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:50.982592 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:50.992795 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b0912-bd71-490a-900a-304e8b17c200 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:50.998121 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:50.998778 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:50.999070 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:50.999352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.000080 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.001717 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.012120 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1464/2894] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:50 2022] GET /identity/v3/roles => generated 1427 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:51.016236 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:51.026185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad8752-95ff-4567-961d-0cad70a36f8e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:51.030820 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:51.031691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.031980 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.032263 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] PATH_INFO: `/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1/users/9973c13ef25a49bca40948249f94a827/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.047156 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fc1e9b4cb8459eaa9509810d7e39d1, user_id=9973c13ef25a49bca40948249f94a827, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.049828 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.063270 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1431/2895] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:51 2022] PUT /identity/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1/users/9973c13ef25a49bca40948249f94a827/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:51.067105 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:51.077422 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a31f1-0c52-45c5-9955-d10a6c5ee915 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:51.132976 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:51.133640 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.133931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.134215 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.134938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.136685 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14230928-e173-4cf5-8eb3-a7e11d78719c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.146399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1465/2896] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:51 2022] GET /identity/v3/roles => generated 1427 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:51.150691 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:51.160876 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6741bd-f6da-4fee-bbfa-5a42fb3b0591 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:51.165406 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:51.166271 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.166555 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.166827 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] PATH_INFO: `/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1/users/9973c13ef25a49bca40948249f94a827/roles/eaf57d93779844cb9e5ee49e1067457b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.169334 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fc1e9b4cb8459eaa9509810d7e39d1, user_id=9973c13ef25a49bca40948249f94a827, role_id=eaf57d93779844cb9e5ee49e1067457b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.171937 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.181911 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1432/2897] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:51 2022] PUT /identity/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1/users/9973c13ef25a49bca40948249f94a827/roles/eaf57d93779844cb9e5ee49e1067457b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:51.193845 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.194400 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.194684 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.221619 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] MFA Rules not processed for user `9973c13ef25a49bca40948249f94a827`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:51.222761 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:51.292982 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1466/2898] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:51.304187 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:51.305940 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:51.363678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df832b-3f69-4f23-b26a-572e55e4c55f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:51.367386 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:51.368022 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:51.368313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:51.368626 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:51.411984 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:51.425146 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:51.426595 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb1339-9c2e-4a19-8fbb-13dd384e99ea service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:51.435426 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1433/2899] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:54.116223 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.134284 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.179312 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dab4fe-7139-4bc0-83e4-4d705463bc0e None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.184524 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.185385 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.185663 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.185938 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] PATH_INFO: `/v3/users/39bdced423af4c1790f259f7f53aa915` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.187107 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bdced423af4c1790f259f7f53aa915)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.189055 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.234656 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bdced423af4c1790f259f7f53aa915'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.247300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bdced423af4c1790f259f7f53aa915'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.255056 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bdced423af4c1790f259f7f53aa915'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.255810 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bdced423af4c1790f259f7f53aa915'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.256447 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bdced423af4c1790f259f7f53aa915'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.268686 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1467/2900] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:54 2022] DELETE /identity/v3/users/39bdced423af4c1790f259f7f53aa915 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:54.273372 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.273873 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.273995 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.291809 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:54.293541 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:54.352611 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1434/2901] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:54.362930 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.364364 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:54.422599 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a50f5-f222-4932-af64-5d39f1a90f3e admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.426256 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.426899 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.427186 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.427467 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.436561 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.438002 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.447540 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1468/2902] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:54.705821 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.707309 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:54.721140 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e2e6a-2e42-4d30-9075-cb9ec45b4d5b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.726011 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.726886 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.727170 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.727447 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] PATH_INFO: `/v3/projects/4d164aed8338482f9706cc21a8653c9f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.728678 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d164aed8338482f9706cc21a8653c9f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.730668 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.778150 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d164aed8338482f9706cc21a8653c9f', 'request_id': 'req-9da539aa-668c-4625-b8c8-6cfbed11b4ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.783716 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d164aed8338482f9706cc21a8653c9f', 'request_id': 'req-9da539aa-668c-4625-b8c8-6cfbed11b4ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.790389 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d164aed8338482f9706cc21a8653c9f', 'request_id': 'req-9da539aa-668c-4625-b8c8-6cfbed11b4ed'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.801568 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] The token cache is being invalidate because project 4d164aed8338482f9706cc21a8653c9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:54.801857 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.802485 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.804038 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1435/2903] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:54 2022] DELETE /identity/v3/projects/4d164aed8338482f9706cc21a8653c9f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:54.808160 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:54.817734 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07211980-2970-4bce-9504-a9bb5e367dc2 service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:54.851236 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:54.874864 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:54.875735 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:54.876030 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:54.876338 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] PATH_INFO: `/v3/users/9973c13ef25a49bca40948249f94a827` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:54.877550 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9973c13ef25a49bca40948249f94a827)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:54.879461 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:54.923377 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9973c13ef25a49bca40948249f94a827'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.934931 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9973c13ef25a49bca40948249f94a827'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.942181 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9973c13ef25a49bca40948249f94a827'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.942843 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9973c13ef25a49bca40948249f94a827'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.943452 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-a1d64dd5-9099-4cc0-8086-da401841a442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9973c13ef25a49bca40948249f94a827'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:54.956654 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1469/2904] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:54 2022] DELETE /identity/v3/users/9973c13ef25a49bca40948249f94a827 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:55.224737 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.226350 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.239432 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da539aa-668c-4625-b8c8-6cfbed11b4ed admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.302018 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.302900 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.303166 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.303448 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] PATH_INFO: `/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.304662 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fc1e9b4cb8459eaa9509810d7e39d1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.306581 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.318826 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.355001 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fc1e9b4cb8459eaa9509810d7e39d1', 'request_id': 'req-f5c00660-9211-4fe7-8d7a-54acd59b589f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.360638 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fc1e9b4cb8459eaa9509810d7e39d1', 'request_id': 'req-f5c00660-9211-4fe7-8d7a-54acd59b589f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.367656 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fc1e9b4cb8459eaa9509810d7e39d1', 'request_id': 'req-f5c00660-9211-4fe7-8d7a-54acd59b589f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.379058 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] The token cache is being invalidate because project 30fc1e9b4cb8459eaa9509810d7e39d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:55.379347 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.379981 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f5c00660-9211-4fe7-8d7a-54acd59b589f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:55.381537 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1436/2905] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:55 2022] DELETE /identity/v3/projects/30fc1e9b4cb8459eaa9509810d7e39d1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:55.386406 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.387516 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.387624 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.405455 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:55.406584 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.464836 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1470/2906] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:55.472268 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.472599 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.472883 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.491646 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:55.492878 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.501313 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1437/2907] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:55.505362 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.515480 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ae108-6222-427d-b593-5d90b4985dcb None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.520037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.520724 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.521015 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.521300 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] PATH_INFO: `/v3/domains` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.522037 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80289) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 17:02:55.522352 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.523953 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.536103 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1471/2908] 10.222.0.102 () {58 vars in 1157 bytes} [Thu May 26 17:02:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 17:02:55.540433 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.550083 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5792c-9d12-403f-b934-a5a0246693b9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.554750 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.555397 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.555687 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.555970 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.556704 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.559183 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.585401 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1438/2909] 10.222.0.102 () {60 vars in 1157 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/projects => generated 370 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:55.589641 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.599675 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e323-2b0c-4c16-a63e-b25dea17553c admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.643840 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:55.661248 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.661856 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.662172 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.662456 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.663156 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.665127 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.685296 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1472/2910] 10.222.0.102 () {60 vars in 1148 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 17:02:55.689385 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.699667 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7725c94-aed8-4d9e-8ff6-e1df00e774b1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.704185 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.704875 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.705165 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.705446 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.706172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.707771 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.719442 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1439/2911] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:55 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:55.723356 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.734320 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283d049-201f-4b87-a736-241913eb1ca6 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.739374 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.740076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.740391 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.740682 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.741404 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.742981 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6490913-357c-4ba8-aa84-3e39f99b6820 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.753695 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1473/2912] 10.222.0.102 () {58 vars in 1126 bytes} [Thu May 26 17:02:55 2022] GET /identity/v3/roles => generated 1427 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 17:02:55.757588 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.768267 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298356-cde6-47ff-9a04-75276e9024fb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.773172 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.774102 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.774396 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.774698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] PATH_INFO: `/v3/projects/1cbea9c5da9f41258ff2772acc8c579a/users/00f8fb51a3e5485f8c0687700cc95f46/roles/43b33b457be34a02b9be138701888988` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.789764 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbea9c5da9f41258ff2772acc8c579a, user_id=00f8fb51a3e5485f8c0687700cc95f46, role_id=43b33b457be34a02b9be138701888988)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.792605 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:55.805549 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1440/2913] 10.222.0.102 () {60 vars in 1487 bytes} [Thu May 26 17:02:55 2022] PUT /identity/v3/projects/1cbea9c5da9f41258ff2772acc8c579a/users/00f8fb51a3e5485f8c0687700cc95f46/roles/43b33b457be34a02b9be138701888988 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:55.816733 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] REQUEST_METHOD: `POST` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.817031 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.817316 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.845216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.auth.core [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] MFA Rules not processed for user `00f8fb51a3e5485f8c0687700cc95f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80289) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:55.846543 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.908706 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1474/2914] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:55.919932 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:55.921698 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:55.977811 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2ede45-5113-4115-8689-140dcf5fa54f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:55.981496 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dd18deb63da438cb8eee3d8e7daa955', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:55.982130 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:55.982415 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:55.982694 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:55.990950 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:55.992404 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e1fd0-bf59-448f-904a-f322d52ec8a8 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.001630 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1441/2915] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:56.026477 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.088199 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82226-0053-4bb6-bf03-38391c7a9c23 None None] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.092893 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.093790 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.094076 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.094354 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] PATH_INFO: `/v3/users/00f8fb51a3e5485f8c0687700cc95f46` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.095548 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f8fb51a3e5485f8c0687700cc95f46)` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.097500 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.144971 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f8fb51a3e5485f8c0687700cc95f46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.150012 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:56.158912 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f8fb51a3e5485f8c0687700cc95f46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.166097 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f8fb51a3e5485f8c0687700cc95f46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.166701 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f8fb51a3e5485f8c0687700cc95f46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.167327 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.notifications [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f8fb51a3e5485f8c0687700cc95f46'} {{(pid=80289) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.180109 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1475/2916] 10.222.0.102 () {58 vars in 1228 bytes} [Thu May 26 17:02:56 2022] DELETE /identity/v3/users/00f8fb51a3e5485f8c0687700cc95f46 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:02:56.185705 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.186000 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.186285 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.203719 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] MFA Rules not processed for user `6f387b0c9da64b528c02340c2727e0f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 17:02:56.204964 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.237965 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:02:56.265836 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1442/2917] 10.222.0.102 () {58 vars in 962 bytes} [Thu May 26 17:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 17:02:56.275006 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.276475 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.333926 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9d27d-589b-4c15-a9a1-1fdc48e817a9 admin admin] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.337620 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a13a32aadcf43d681c5aeef7c9e1fcb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.338265 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.338559 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.338841 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.347762 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.349232 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.359064 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1476/2918] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:02:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:02:56.623977 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:02:56.625487 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:02:56.639658 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5eac-76e7-4a6f-8ef5-1467422fae80 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:02:56.644314 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f387b0c9da64b528c02340c2727e0f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d72a14f73b1482981ce0e1b7a09f3ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:02:56.645708 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:02:56.646169 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:02:56.646454 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] PATH_INFO: `/v3/projects/1cbea9c5da9f41258ff2772acc8c579a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:02:56.647639 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbea9c5da9f41258ff2772acc8c579a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:02:56.649802 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:02:56.696256 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbea9c5da9f41258ff2772acc8c579a', 'request_id': 'req-cdae1894-fa52-4736-9ba4-93e09e5bedbf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.702325 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbea9c5da9f41258ff2772acc8c579a', 'request_id': 'req-cdae1894-fa52-4736-9ba4-93e09e5bedbf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.709106 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbea9c5da9f41258ff2772acc8c579a', 'request_id': 'req-cdae1894-fa52-4736-9ba4-93e09e5bedbf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.719770 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] The token cache is being invalidate because project 1cbea9c5da9f41258ff2772acc8c579a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 17:02:56.720044 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.720679 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cdae1894-fa52-4736-9ba4-93e09e5bedbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 17:02:56.722207 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1443/2919] 10.222.0.102 () {58 vars in 1237 bytes} [Thu May 26 17:02:56 2022] DELETE /identity/v3/projects/1cbea9c5da9f41258ff2772acc8c579a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 17:03:06.354375 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=36,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:03:06.716847 dv-cinder-836071-5-iscsi devstack@keystone.service[80290]: DEBUG dbcounter [-] [80290] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 17:05:16.520547 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] Authenticating user token {{(pid=80289) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 17:05:16.521962 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:16.612032 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4e452d-1b10-4973-86f2-1e32a93b0eaa service neutron] Validating token access rules against request {{(pid=80289) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 17:05:16.670754 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b1115a902664ed991ab40344b36cd60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e1b239e39e344b8978ca7835fdf0ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80289) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 17:05:16.671399 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] REQUEST_METHOD: `GET` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 17:05:16.671687 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] SCRIPT_NAME: `/identity` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 17:05:16.671967 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80289) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 17:05:16.673876 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.fernet_utils [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80289) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 17:05:16.685650 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 17:05:16.687216 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd1d05-5c93-46ec-823d-b61c794a06dd service placement] RBAC: Authorization granted {{(pid=80289) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 17:05:16.697188 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: [pid: 80289|app: 0|req: 1477/2920] 10.222.0.102 () {60 vars in 1370 bytes} [Thu May 26 17:05:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 17:05:26.692783 dv-cinder-836071-5-iscsi devstack@keystone.service[80289]: DEBUG dbcounter [-] [80289] Writing DB stats keystone:SELECT=67 {{(pid=80289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}